-- Logs begin at Thu 2022-08-04 20:02:24 UTC, end at Thu 2022-08-04 21:45:17 UTC. -- Aug 04 21:15:42.292095 dv-cinder-852208-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 21:15:42.301173 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 21:15:42 2022] *** Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: nodename: dv-cinder-852208-1-iscsi Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: machine: x86_64 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: clock source: unix Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: pcre jit disabled Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: detected number of CPU cores: 4 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: current working directory: / Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: detected binary path: /usr/bin/uwsgi-core Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: your processes number limit is 47680 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: your memory page size is 4096 bytes Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: detected max file descriptor number: 2048 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: lock engine: pthread robust mutexes Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: thunder lock: enabled Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 21:15:42.305097 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 21:15:42.344617 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: Python main interpreter initialized at 0x55ec35c1f9c0 Aug 04 21:15:42.344617 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: python threads support enabled Aug 04 21:15:42.344617 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: your server socket listen backlog is limited to 100 connections Aug 04 21:15:42.344617 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: your mercy for graceful operations on workers is 90 seconds Aug 04 21:15:42.345029 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 21:15:42.345029 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: *** Operational MODE: preforking *** Aug 04 21:15:42.345297 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: *** uWSGI is running in multiple interpreter mode *** Aug 04 21:15:42.345297 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: spawned uWSGI master process (pid: 103997) Aug 04 21:15:42.345509 dv-cinder-852208-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 21:15:42.346326 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: spawned uWSGI worker 1 (pid: 103998, cores: 1) Aug 04 21:15:42.346434 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: spawned uWSGI worker 2 (pid: 103999, cores: 1) Aug 04 21:15:42.346602 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 21:15:43.036464 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:15:43.046002 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:15:44.141384 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:15:44.141384 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: from cryptography.utils import int_from_bytes Aug 04 21:15:44.142074 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:15:44.142074 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: from cryptography.utils import int_from_bytes Aug 04 21:15:44.153572 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:15:44.153572 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: from cryptography.utils import int_from_bytes Aug 04 21:15:44.154080 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:15:44.154080 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: from cryptography.utils import int_from_bytes Aug 04 21:15:46.725558 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:15:46.725558 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:15:46.726961 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:15:46.726961 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:15:46.727217 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:15:46.727902 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.728459 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.729051 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.729610 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.730195 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.730750 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.731341 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.731914 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.732489 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.732949 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.733518 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.734080 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-1-iscsi {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.734662 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.735210 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.735891 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.736284 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:15:46.737040 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.737283 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:15:46.737530 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.737828 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:15:46.737828 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:15:46.738269 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.738435 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:15:46.738585 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.738736 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.738736 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.738736 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.739141 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.739308 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.739308 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.739825 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.740070 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.740282 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.740461 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.740775 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.741035 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.741263 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.741263 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.741547 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.741691 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.741864 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-1-iscsi {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.742022 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.742238 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.742425 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.742552 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.742791 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.742962 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.743404 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.743597 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.743750 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.744035 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.744255 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.744519 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.744746 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.744950 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-1-iscsi {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.745179 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.745406 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.745599 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.745599 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.745960 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.746150 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.746367 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.746588 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.746742 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.746882 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747031 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747187 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747359 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747514 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747514 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747782 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.747918 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.748056 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.748208 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.748417 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-1-iscsi {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.748661 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.748818 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.749030 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.749185 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.749344 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.749482 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.749693 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.749846 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.750032 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.750238 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.750450 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.750604 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.750749 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.751064 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.751222 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.751399 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.751565 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.751826 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.751973 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.752147 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.752381 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.752515 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.752778 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.752937 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.753077 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.753386 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.753485 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.753697 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.753943 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.754045 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.754308 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.754532 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.754626 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.754853 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.755118 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.755207 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.755491 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.755724 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.755821 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.756123 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.756223 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.756376 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.756619 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.756708 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.756936 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.757192 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.757287 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.757546 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.757771 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.757865 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.758308 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.758417 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.758612 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.758829 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.758916 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.759210 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.759335 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.759537 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.759813 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.759907 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.760680 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.760880 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.761042 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.761300 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.761446 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.761611 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.762796 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.763033 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.763225 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.763436 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.763607 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.763716 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.763861 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764047 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764197 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764367 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764528 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764683 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764826 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.764988 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.765132 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.765283 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.765435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.765573 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.765717 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.765872 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766014 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766153 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766291 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766291 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766565 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766721 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.766721 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767010 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767178 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767178 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767485 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767630 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767773 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.767934 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.768073 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.768234 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.768504 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.768651 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.768800 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.768942 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.769099 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.769241 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.769400 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.769550 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.769688 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.769826 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.770094 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.770244 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.770445 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.770701 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.770845 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771013 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771173 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771385 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771555 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771710 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771850 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.771991 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.772142 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.772299 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.772440 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.772582 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.772721 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.772862 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.773001 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.773164 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.773306 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.773512 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.773695 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.773954 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774096 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774258 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774391 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774534 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774678 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774822 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.774962 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.775152 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.775284 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.775524 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.775659 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.775911 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.776551 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.776706 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.776841 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.776942 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777051 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777174 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777331 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777461 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777659 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777808 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.777973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.778104 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.778285 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.778582 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.778720 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.778911 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.779060 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.779254 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.779465 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.779640 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.779795 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.779948 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.780077 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.780204 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.780446 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.780600 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.780756 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.780889 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.781066 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.781299 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.781508 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.781705 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.781888 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.782075 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.782269 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.782428 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.782585 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.782730 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.782883 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.783035 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.783185 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.783360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.783531 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.783741 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.783958 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.784102 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.784258 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.784420 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.784574 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.784724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.784878 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.785029 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.785170 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.785398 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.785544 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.785687 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.785841 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.785979 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.786139 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.786304 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:15:46.786445 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.786585 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.786729 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.786870 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.787027 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.787182 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.787426 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.787587 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.787729 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.787863 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.788014 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.788164 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.788312 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.788454 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.788714 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.788863 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.789079 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.789225 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.789406 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.789548 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.789743 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.790070 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.790229 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.790372 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.790532 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.790721 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.790877 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.791034 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.791411 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.791563 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.791717 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.791861 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792002 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792144 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792299 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792429 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792583 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792726 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.792869 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.793023 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.793179 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.793321 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.793462 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.793617 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.793804 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794020 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794170 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794312 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794453 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794595 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794749 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.794901 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.795056 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.795213 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.795416 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.795561 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.795705 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.795872 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796015 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796167 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796315 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796468 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796624 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796791 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.796937 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797091 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797234 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797383 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797539 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797694 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797837 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.797974 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.798122 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.798262 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.798420 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.798564 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.798704 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.798854 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799008 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799147 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799304 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799492 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799636 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799778 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.799930 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800072 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800235 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800374 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800517 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800659 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800811 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.800966 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.801123 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.801327 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.801531 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.801673 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.801858 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.802284 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.802427 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.802599 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.802747 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.802901 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.803045 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.803240 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.803444 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.803588 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.803742 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.803960 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.804160 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.804320 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.804475 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.804619 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.804786 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.804932 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805086 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805245 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805388 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805537 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805665 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805808 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.805966 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806109 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806250 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806391 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806565 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806719 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806858 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.806997 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.807199 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.807388 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.807536 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.807663 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.807835 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.807980 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.808143 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.808316 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.808471 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.808623 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.808788 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.808928 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809071 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809223 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809365 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809516 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809653 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809794 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.809933 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.810068 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.810246 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.810396 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.810638 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.810807 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.810951 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.811094 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.811244 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.811448 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.811607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.811753 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.811897 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812042 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812196 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812340 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812482 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812691 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812850 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.812993 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.813154 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.813301 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.813446 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.813597 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.813740 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.813890 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814113 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814254 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814384 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814526 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814671 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814833 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.814990 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.815146 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.815300 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.815553 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.815694 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.815838 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.815982 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.816124 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.816269 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.816413 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.816555 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.816713 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.816878 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.817070 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.817228 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.817520 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.817796 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.817908 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.818115 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.818197 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.818433 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.818510 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.818775 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.819030 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.819138 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.819418 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.819665 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.819809 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.820029 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.820277 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.820430 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.820675 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.820880 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.821031 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.821347 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.821499 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.821671 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.821995 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.822124 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.822315 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.823163 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.823256 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.823665 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.823806 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.824002 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.824318 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.824405 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.824637 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.824967 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.825096 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.825288 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.825586 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.825735 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.825917 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.826226 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.826361 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.826547 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.826844 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.826998 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.827153 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.827499 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.827653 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.827841 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.828107 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.828255 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.828468 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.828710 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.828864 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.829095 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.829375 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.829525 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.829704 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.830025 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.830176 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.830330 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.830639 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.830776 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.831014 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.831269 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.831391 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.831761 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.831897 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.832074 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.832400 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.832533 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.832712 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.833027 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.833118 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.833566 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.833700 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.834130 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.834271 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.834709 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.834889 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.835056 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.835433 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.835589 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.835740 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.836036 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.836196 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.836385 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.836708 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.836872 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.837017 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.837324 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.837519 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.837629 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.837945 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.838030 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.838822 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.839234 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.839532 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.839739 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.839880 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.840165 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.840337 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.840482 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.840790 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.840979 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.841129 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.841415 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.841582 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.841727 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.842048 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.842215 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.842359 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.842691 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.842835 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.843011 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.843141 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.843359 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.843651 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.843782 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.843976 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.844309 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.844399 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.844649 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.844937 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.845056 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.845286 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.845500 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.845634 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.845946 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.846086 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.846254 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.846574 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.846662 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.846898 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.847236 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.847348 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.847721 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.847822 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.848038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.848353 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.848439 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.848680 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.848955 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.849054 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.849315 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.849401 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.849764 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.849909 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.850097 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.850395 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.850556 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.850706 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.850973 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.851116 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.851352 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.851596 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.851712 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.851960 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.852186 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.852290 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.852567 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.852796 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.852883 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.853316 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.853526 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.853723 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.853939 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.854253 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.854345 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.854574 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.854901 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.854991 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.855248 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.855421 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.855609 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.855871 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.855969 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.856271 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.856456 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.856580 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.856891 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.857044 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.857195 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.857507 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.857643 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.857812 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.858202 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.858305 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.858514 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.858820 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.858909 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.859151 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.859309 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.859481 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.859797 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.859906 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.860130 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.860417 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.860524 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.860736 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.861033 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.861135 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.861358 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.861453 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.861663 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.861909 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.862006 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.862281 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.862506 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.862593 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.862873 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.863109 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.863209 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.863534 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.863778 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.863866 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.864169 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.864383 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.864487 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.864855 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.864954 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.865165 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.865313 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.865620 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.865921 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.866060 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.866379 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.866543 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.866713 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.866880 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.867024 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.867356 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.867507 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.867654 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.869001 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.869230 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.869230 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.870264 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.870425 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.870425 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.870767 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.870890 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.870890 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.871405 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.871550 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.871550 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.871914 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.872120 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.872120 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.872349 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.872645 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.872645 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.872645 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873216 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873304 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873304 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873455 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873532 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873619 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873706 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873785 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.873925 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.874013 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.874319 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.874534 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.874629 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.874933 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.875161 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.875255 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.875793 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.875949 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.876091 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.876334 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.876461 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.876631 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.876946 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.877090 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.877260 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.877539 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.877673 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.877853 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.878143 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.878314 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.878455 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.878736 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.878861 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.879082 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.879174 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.879423 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.879677 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.879779 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.880016 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.880257 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.880344 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.880620 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.880857 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.881123 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.881448 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.881603 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.881762 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.882044 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.882132 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.882403 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.882628 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.882804 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.883102 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.883198 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.883462 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.883613 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.883883 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.884086 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.884187 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.884416 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.884726 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.884877 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.885896 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.886067 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.886270 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.886497 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.886636 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.887073 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.887162 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.887475 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.887720 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.887810 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.888099 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.888327 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.888434 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.888708 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.888904 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.889170 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.889500 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.890065 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.890688 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.891292 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.891964 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.892518 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.893194 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.893486 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.893595 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.893730 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.893931 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.894284 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.894369 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.894621 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.894918 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.895007 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.895277 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.895537 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.895627 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.895968 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.896137 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.896286 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.896609 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.896728 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.896951 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.897165 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.897323 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.897579 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.897666 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.897897 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.898198 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.898284 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.898517 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.898767 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.898856 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.899155 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.899502 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.899813 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.899914 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.900367 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.900522 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.900835 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.901013 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.901346 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.901617 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.901794 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.902211 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.902299 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.902720 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.902832 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.903165 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.903260 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.903651 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.903795 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.904063 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.904380 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.904473 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.904754 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.904839 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.905207 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.905308 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.905529 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.905813 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.905907 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.906155 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.906426 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.906524 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.906774 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.907017 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.907146 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.907423 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.907661 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.907763 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.908169 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.908259 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.908486 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.908575 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.908801 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.909113 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.909200 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.909419 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.909724 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.909843 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.910058 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.910146 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.910384 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.910573 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.910691 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.910999 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.911193 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.911306 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.911653 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.911829 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.911962 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.912284 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.912429 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.912701 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.913015 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.913100 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.913327 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.913616 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.913781 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.914030 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.914151 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.914372 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.914617 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.914714 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.915006 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.915214 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.915348 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.915650 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.915749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.915970 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.916058 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.916281 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.916629 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.916723 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.916954 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.917225 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.917313 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.917572 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.917814 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.917910 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.918188 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.918404 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.918534 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.918815 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.918921 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.919159 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.919442 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.919621 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.919865 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.920082 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.920203 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.920400 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.920532 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.920725 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.920860 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.921061 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.921200 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.921679 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.921820 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.921820 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.921974 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.922136 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.922412 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.922507 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.922765 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.922853 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.923127 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.923222 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.923474 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.923577 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.923847 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.923935 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.924165 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.924252 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.924484 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.924578 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.924803 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.924890 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.925114 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.925210 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.925426 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.925521 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.925749 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.925844 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.926060 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.926184 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.926382 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.926528 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.926703 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.927180 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.927376 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.927530 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.927616 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.927848 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.927947 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.928288 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.928404 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.928496 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.928586 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.928963 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929079 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929163 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929243 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929380 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929480 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929685 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.929798 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.930115 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.930211 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.930432 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.930529 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.930750 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.930845 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.931068 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.931155 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.931419 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.931527 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.931736 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.931824 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.932595 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.932691 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.932916 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.933013 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.933235 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.933352 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.933560 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.933707 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.933874 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934015 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934190 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934328 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934508 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934637 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934826 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.934952 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.935139 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.935259 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.935495 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.935585 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.935814 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.935902 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.936129 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.936218 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.936453 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.936611 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.936767 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.936854 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.937072 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.937161 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.937384 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.937470 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.937686 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.937830 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.938007 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.938153 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.938466 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.938565 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.938779 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.938923 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.939096 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.939238 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.939436 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.939576 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.939759 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.939924 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.940079 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.940234 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.940392 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.940567 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.940817 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.940914 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.941134 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.941222 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.941451 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.941537 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.941768 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.941863 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.942079 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.942166 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.942412 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.942947 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943112 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943286 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943392 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943542 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943655 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943868 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.943957 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.944186 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.944273 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.944507 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.944594 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.944827 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.944917 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.945148 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.945302 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.945621 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.945717 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.945935 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.946023 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.946343 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.946429 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.946666 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.946828 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.946986 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.947078 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.947298 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.947526 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.947729 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.948380 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.948548 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.948692 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.948858 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.948938 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.949182 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.949310 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.949503 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.949612 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.949827 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.949914 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.950149 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.950238 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.950466 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.950553 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.950789 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.950884 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.951101 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.951201 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.951437 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.951529 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.951755 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.951843 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.952071 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.952161 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.952403 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.952513 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.952742 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.952909 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.953046 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.953136 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.953443 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.953539 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.953757 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.953855 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.954076 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.954181 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.954383 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.954470 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.954694 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.954810 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955005 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955091 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955355 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955500 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955648 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955737 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.955959 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956046 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956268 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956355 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956582 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956683 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956896 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.956983 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.957212 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.957300 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.957522 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.957610 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.957839 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.957951 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.958144 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.958242 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.958454 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.958548 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.958782 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.958986 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.959086 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.959306 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.959429 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.959675 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.959806 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.959994 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.960100 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.960318 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.960428 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.960637 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.960756 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.960952 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961040 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961259 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961353 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961568 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961656 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961871 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.961966 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.962186 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.962274 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.962494 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.962589 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.962795 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.962891 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.963117 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.963234 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.963533 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.963730 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.963877 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.964039 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.964212 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.964362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.964534 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.964675 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.964858 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.965192 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.965457 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.965660 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.965810 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.965981 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.966131 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.966302 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.966463 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.966621 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.966788 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.966933 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.967108 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.967246 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.967442 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.967589 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.967770 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.967902 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.968081 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.968215 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.968388 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.968525 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.968705 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.968854 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.969017 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.969165 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.969582 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.969686 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.969801 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.969914 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.970113 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.970384 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.970474 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.970711 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.970794 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971024 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971113 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971359 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971463 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971670 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971757 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.971999 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.972089 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.972310 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.972397 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.972615 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.972712 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.972921 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973009 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973232 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973318 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973535 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973640 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973886 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.973981 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.974207 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.974431 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.974564 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.974737 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.974881 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.975051 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.975236 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.975382 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.975658 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.975758 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.975932 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.976020 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.976286 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.976511 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.976636 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.976850 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.976966 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.977175 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.977305 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.977493 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.977633 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.977798 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.977889 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.978119 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.978433 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.978536 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.978746 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979029 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979121 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979190 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979433 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979539 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979757 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.979877 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.980091 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.980187 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.980419 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.980516 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.980751 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.980838 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.981092 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.981307 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.981417 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.981644 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.981733 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.981966 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.982054 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.982309 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.982395 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.982640 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.982729 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.982950 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.983047 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.983258 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.983473 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.983592 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.983680 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.983917 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984020 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984256 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984378 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984570 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984659 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984887 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.984982 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.985206 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.985301 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.985518 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.985607 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.985828 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.985935 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.986142 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.986239 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.986452 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.986540 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.986762 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.986857 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.987072 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.987161 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.987405 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.987496 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.987715 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.987802 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988024 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988114 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988333 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988421 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988646 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988742 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.988986 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.989186 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.989302 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.989511 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.989620 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.989851 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.989939 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.990182 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.990270 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.990514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.990601 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.990829 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.990917 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.991138 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.991226 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.991481 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.991584 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.991793 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.991879 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.992105 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.992192 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.992420 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.992515 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.992726 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.992813 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993031 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993152 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993362 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993458 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993681 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993794 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.993989 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.994084 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.994315 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.994410 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.995172 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.995260 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.995546 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.995737 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.995860 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.996092 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.996180 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.996416 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.996503 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.996745 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.996840 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.997082 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.997170 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.997404 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.997506 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.997716 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.997813 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998027 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998121 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998332 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998481 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998636 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998726 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.998943 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999030 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999255 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999351 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999589 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999677 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999892 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:46.999987 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.000191 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.000280 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.000512 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.000697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.000783 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.000864 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.001088 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.001185 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.001389 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.001479 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.001690 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.001779 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002000 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002097 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002300 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002387 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002601 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002688 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002900 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.002995 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.003199 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.003294 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.003524 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.003624 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.003825 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.003926 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.004132 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.004353 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.004475 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.004684 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.004762 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.005023 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.005140 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.005338 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.005457 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.005654 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.005908 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006000 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006219 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006306 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006550 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006636 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006879 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.006967 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.007198 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.007286 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.007580 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.007683 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.007945 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008042 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008265 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008352 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008584 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008671 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008899 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.008986 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.009216 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.009302 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.009529 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.009624 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.009838 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.009927 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.010783 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.010999 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.011137 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.011380 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.011484 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.011713 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.011802 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.012056 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.012145 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.012398 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.012486 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.012713 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.012852 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013026 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013175 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013331 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013471 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013637 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013722 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.013949 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014047 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014263 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014358 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014577 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014680 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014886 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.014981 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.015194 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.015282 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.015532 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.015632 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.015843 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.015938 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.016150 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.016245 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.016460 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.016548 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.016766 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.016858 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017077 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017175 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017385 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017472 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017690 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017778 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.017997 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.018084 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.018309 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.018398 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.018623 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.018713 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.018945 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.019055 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.019279 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.019429 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.019618 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.019728 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.019936 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.020076 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.020254 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.020389 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.020572 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.020725 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.020883 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.021059 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.021198 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.021434 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.021525 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.021764 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.021852 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.022084 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.022181 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.022451 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.022625 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.022880 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.023058 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.023198 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.023415 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:15:47.023564 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.023860 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.024177 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.025834 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.025834 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.025834 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.025834 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.025834 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.026419 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.026521 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.026858 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.027193 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.027529 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.027841 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.028150 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.028466 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.028790 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.029103 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.029410 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.029716 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.030029 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.030336 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.030644 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.030950 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.031256 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.031591 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.031898 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.032211 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.032516 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.032820 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.033127 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.033432 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.033742 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.034049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.034359 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.034667 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.034975 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.035281 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.035640 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.035975 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.036293 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.036619 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.036933 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.037260 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.037571 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.037896 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.038224 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.038547 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.038858 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.039195 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.039534 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.039922 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.040247 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.040565 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.040874 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.041189 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.041522 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.041855 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.042201 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.042532 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.042853 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.043182 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.043529 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.043854 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.044185 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.044499 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.044814 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.045130 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.045449 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.045763 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.046083 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.046395 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.046716 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.047040 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.047382 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.047719 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.048050 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.048367 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.048695 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.049024 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.049382 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.049700 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.050050 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.050388 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.050710 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.051036 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.051362 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:15:47.051616 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:15:47.185874 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO dbcounter [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Registered counter for database nova_api Aug 04 21:15:47.206373 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO dbcounter [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Registered counter for database nova_api Aug 04 21:15:47.210177 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.217340 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.227166 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_db.sqlalchemy.engines [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.234697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writer thread running {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.275190 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.context [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),276ce854-5a06-42fd-a4c0-ee9620cd609a(cell1) {{(pid=103998) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:15:47.279161 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:15:47.279706 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:15:47.281305 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:15:47.282129 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:15:47.282487 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:15:47.284573 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:15:47.286608 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO dbcounter [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Registered counter for database nova_cell0 Aug 04 21:15:47.290814 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.context [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),276ce854-5a06-42fd-a4c0-ee9620cd609a(cell1) {{(pid=103999) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:15:47.294006 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO dbcounter [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Registered counter for database nova_cell1 Aug 04 21:15:47.295448 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_concurrency.lockutils [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:15:47.296001 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_concurrency.lockutils [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:15:47.297597 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_concurrency.lockutils [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:15:47.298346 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_concurrency.lockutils [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:15:47.298798 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_concurrency.lockutils [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:15:47.300874 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_concurrency.lockutils [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:15:47.302235 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.303277 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO dbcounter [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Registered counter for database nova_cell0 Aug 04 21:15:47.304012 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.309592 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO dbcounter [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Registered counter for database nova_cell1 Aug 04 21:15:47.310725 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.312976 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.317222 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_db.sqlalchemy.engines [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.319956 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_db.sqlalchemy.engines [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.324620 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writer thread running {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.457835 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO dbcounter [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Registered counter for database nova_cell0 Aug 04 21:15:47.463386 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writer thread running {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.468980 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_db.sqlalchemy.engines [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.473497 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writer thread running {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.474620 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO dbcounter [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Registered counter for database nova_cell0 Aug 04 21:15:47.485622 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG oslo_db.sqlalchemy.engines [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:15:47.490391 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writer thread running {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:15:47.880258 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:15:47.887604 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:15:47.909992 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: WARNING keystonemiddleware.auth_token [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:15:47.917949 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: WARNING keystonemiddleware.auth_token [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:15:48.243412 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:15:48.249662 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: WARNING keystonemiddleware.auth_token [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:15:48.255050 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ec35c1f9c0 pid: 103998 (default app) Aug 04 21:15:48.257314 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:15:48.258557 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001902 Aug 04 21:15:48.258965 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu Aug 4 21:15:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:15:48.269117 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: WARNING keystonemiddleware.auth_token [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:15:48.275288 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: WARNING keystonemiddleware.auth_token [None req-7702e23c-8b46-46ae-b6fe-c1fe586992b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:15:48.281343 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ec35c1f9c0 pid: 103999 (default app) Aug 04 21:17:20.078703 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:20.080851 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003234 Aug 04 21:17:20.082130 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:20.101234 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_api:SELECT=3 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:20.102434 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_cell1:SELECT=3 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:20.104455 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_cell0:SELECT=3 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:20.106586 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:21.732028 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-4e399a34-8a9b-485f-bd12-f7c34b649d14 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:21.782063 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-4e399a34-8a9b-485f-bd12-f7c34b649d14 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.688800 Aug 04 21:17:21.795256 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Aug 4 21:17:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:17:24.854833 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:24.856483 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-6106d94d-a9bc-4a43-bb02-0f0fffb48d57 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 Aug 04 21:17:24.856872 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:25.662326 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-20974d77-a6ae-4a34-b618-939f704987b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:25.694789 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:17:25.694789 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: warnings.warn(msg) Aug 04 21:17:25.819341 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-20974d77-a6ae-4a34-b618-939f704987b7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.954877 Aug 04 21:17:25.823925 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:17:25.840297 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=3 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:25.843083 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell1:SELECT=3 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:25.844600 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell0:SELECT=3 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:25.845338 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:26.140934 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-cd5603eb-ab91-4fea-9237-33b09539741c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:26.147534 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:17:26.147534 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: warnings.warn(msg) Aug 04 21:17:26.364980 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-cd5603eb-ab91-4fea-9237-33b09539741c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.529675 Aug 04 21:17:26.380661 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Aug 4 21:17:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:17:29.389982 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-20974d77-a6ae-4a34-b618-939f704987b7 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:29.391265 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-20974d77-a6ae-4a34-b618-939f704987b7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Aug 04 21:17:29.392288 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:30.528906 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-fc32dd71-c3bd-47d2-85b1-8102d72c7e82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:30.568430 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:17:30.568430 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: warnings.warn(msg) Aug 04 21:17:30.701181 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-fc32dd71-c3bd-47d2-85b1-8102d72c7e82 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.298717 Aug 04 21:17:30.702396 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:17:30.726806 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-42f734c9-1598-40ec-9e61-b3969f0b39fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:30.732213 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:17:30.732213 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: warnings.warn(msg) Aug 04 21:17:30.940695 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-42f734c9-1598-40ec-9e61-b3969f0b39fa admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.219207 Aug 04 21:17:30.941684 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Aug 4 21:17:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:17:33.927961 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-fc32dd71-c3bd-47d2-85b1-8102d72c7e82 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:33.929233 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-fc32dd71-c3bd-47d2-85b1-8102d72c7e82 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 04 21:17:33.929630 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:34.489166 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-016fcd22-3f88-449d-a9bd-78707974d2fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:34.637131 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-016fcd22-3f88-449d-a9bd-78707974d2fc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697020 Aug 04 21:17:34.637689 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:17:34.653126 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-2f1dd174-18ec-41f2-8943-4806fc2fe6a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:34.802753 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-2f1dd174-18ec-41f2-8943-4806fc2fe6a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154006 Aug 04 21:17:34.803220 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Aug 4 21:17:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:17:37.644790 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-016fcd22-3f88-449d-a9bd-78707974d2fc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:37.645353 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-016fcd22-3f88-449d-a9bd-78707974d2fc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 04 21:17:37.647123 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:17:38.301900 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-cc2f3a07-38e0-4fe0-9132-db35f1647058 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "disk": 10}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:38.405829 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-cc2f3a07-38e0-4fe0-9132-db35f1647058 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.752896 Aug 04 21:17:38.406766 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:17:38.419252 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-f37e53d7-f92c-49d4-a060-62ddd279d673 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:38.529811 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-f37e53d7-f92c-49d4-a060-62ddd279d673 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114289 Aug 04 21:17:38.530413 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Aug 4 21:17:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:17:41.090806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-cc2f3a07-38e0-4fe0-9132-db35f1647058 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:41.091849 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-cc2f3a07-38e0-4fe0-9132-db35f1647058 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 04 21:17:41.092237 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:17:41.808158 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-6dc238ad-35b1-4117-ae83-2e89f808ee10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:41.920249 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-6dc238ad-35b1-4117-ae83-2e89f808ee10 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.821482 Aug 04 21:17:41.921597 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:17:41.938038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-f43fcc8e-c91a-4527-bb4b-af69e01cfe05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:42.041135 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-f43fcc8e-c91a-4527-bb4b-af69e01cfe05 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108899 Aug 04 21:17:42.041721 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Aug 4 21:17:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:17:44.935342 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-6dc238ad-35b1-4117-ae83-2e89f808ee10 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:44.936448 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-6dc238ad-35b1-4117-ae83-2e89f808ee10 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 04 21:17:44.936866 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:45.526728 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-a762b83d-45e7-4240-9f06-59433763bca8 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:45.560953 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-a762b83d-45e7-4240-9f06-59433763bca8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.616446 Aug 04 21:17:45.561961 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Aug 4 21:17:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:17:48.026264 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-6dc238ad-35b1-4117-ae83-2e89f808ee10 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:48.027226 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-6dc238ad-35b1-4117-ae83-2e89f808ee10 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 04 21:17:48.028164 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:48.509548 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-816da7fc-b24d-4e6b-92bf-5c34e4742942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "vcpus": 1}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:48.614777 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-816da7fc-b24d-4e6b-92bf-5c34e4742942 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.580336 Aug 04 21:17:48.615466 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:17:48.628648 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-d1a89b5f-fbc4-491e-9203-460d41b04ca6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:48.733079 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-d1a89b5f-fbc4-491e-9203-460d41b04ca6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108105 Aug 04 21:17:48.733675 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Aug 4 21:17:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:17:51.278304 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-816da7fc-b24d-4e6b-92bf-5c34e4742942 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:51.280244 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-816da7fc-b24d-4e6b-92bf-5c34e4742942 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002696 Aug 04 21:17:51.280907 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:51.779461 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-c599c15a-33da-4bf2-8b6f-4b0187f32c46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:51.785160 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:51.914340 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-c599c15a-33da-4bf2-8b6f-4b0187f32c46 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.625400 Aug 04 21:17:51.915005 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:17:51.928316 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-5a859632-376d-45b7-b07c-0d83ebd8f1ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:52.025834 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-5a859632-376d-45b7-b07c-0d83ebd8f1ed admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101191 Aug 04 21:17:52.026412 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Aug 4 21:17:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:17:54.650268 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-c599c15a-33da-4bf2-8b6f-4b0187f32c46 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:54.651843 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-c599c15a-33da-4bf2-8b6f-4b0187f32c46 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002486 Aug 04 21:17:54.654339 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:55.287336 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-a9cf7c9f-6191-4f93-8b56-8a8f38f4ad44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:55.650354 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-a9cf7c9f-6191-4f93-8b56-8a8f38f4ad44 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.987244 Aug 04 21:17:55.651290 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:17:55.671949 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-8291f5da-2a9f-4332-ba84-0dce452c8178 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:55.825813 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-8291f5da-2a9f-4332-ba84-0dce452c8178 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.161621 Aug 04 21:17:55.826657 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Aug 4 21:17:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:17:58.293743 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-a9cf7c9f-6191-4f93-8b56-8a8f38f4ad44 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:17:58.295908 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-a9cf7c9f-6191-4f93-8b56-8a8f38f4ad44 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 21:17:58.295908 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:17:58.980825 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-1440fb06-7ddf-4546-a005-7bec37c7ea28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:59.156520 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-1440fb06-7ddf-4546-a005-7bec37c7ea28 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.854051 Aug 04 21:17:59.157367 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:17:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:17:59.171831 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-5677c429-a810-42d3-ae08-e99093a2c100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:17:59.360395 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-5677c429-a810-42d3-ae08-e99093a2c100 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.192816 Aug 04 21:17:59.375408 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Aug 4 21:17:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:18:01.851628 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-1440fb06-7ddf-4546-a005-7bec37c7ea28 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:01.853248 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-1440fb06-7ddf-4546-a005-7bec37c7ea28 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002412 Aug 04 21:18:01.854212 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:02.464854 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-f51c8f81-e889-4253-ad77-01e5f2ac6c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:18:02.475058 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:02.587604 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-f51c8f81-e889-4253-ad77-01e5f2ac6c17 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.724115 Aug 04 21:18:02.588371 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Aug 4 21:18:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:18:02.604956 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-5bb1e130-d516-4680-b772-f8dbef1ab623 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:18:02.762618 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-5bb1e130-d516-4680-b772-f8dbef1ab623 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.163971 Aug 04 21:18:02.767070 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Aug 4 21:18:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:18:23.824351 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-f51c8f81-e889-4253-ad77-01e5f2ac6c17 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:23.825296 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-f51c8f81-e889-4253-ad77-01e5f2ac6c17 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 04 21:18:23.825703 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:18:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:23.841724 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:24.362496 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-7daf26a5-ac7a-4f53-ae79-be3424077680 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:24.386364 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-7daf26a5-ac7a-4f53-ae79-be3424077680 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.552874 Aug 04 21:18:24.387049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Aug 4 21:18:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:18:25.629183 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-f51c8f81-e889-4253-ad77-01e5f2ac6c17 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:25.630829 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-f51c8f81-e889-4253-ad77-01e5f2ac6c17 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002234 Aug 04 21:18:25.631400 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:26.315253 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-a6f6d4b9-0d52-4557-9526-ac25a857e92c admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:26.323010 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.wsgi [None req-a6f6d4b9-0d52-4557-9526-ac25a857e92c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-a6f6d4b9-0d52-4557-9526-ac25a857e92c admin admin] Request method failure captured: Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Accept: application/json Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Accept-Encoding: gzip, deflate Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Connection: keep-alive Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Content-Length: 0 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Host: 10.222.0.25 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Openstack-Api-Version: compute 2.90 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Openstack-System-Scope: None Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: User-Agent: python-novaclient Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Auth-Token: gAAAAABi7Dehr2VwXD5bPzH3RGEHrBCQ_TleKnhrqfo-JtEG8rmWH8JkhHP42FHPij9XZZ-5aRRJkCWyKYY62nU-Fpv5qAkvWjZtUGuz4zNpt6fso1WNTUfwSDbWQ7Vnb_Ps7WjyJp8DI3O7Vfo05VvY5RMT8xWXClqgx10293fNGM5BKino5x8 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Domain-Id: None Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Domain-Name: None Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Identity-Status: Confirmed Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Is-Admin-Project: True Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Domain-Id: default Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Domain-Name: Default Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Name: admin Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Role: admin,member,reader Aug 04 21:18:26.326697 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Roles: admin,member,reader Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6da47929012341928c673a2e0d1e97f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant: admin Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant-Name: admin Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User: admin Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Domain-Id: default Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Domain-Name: Default Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Id: bc6bad33dfb24427b1ccf30de722b45a Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Name: admin Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: method: > Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: exception: Flavor 42 could not be found. Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: action_args: {'id': '42'} Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:18:26.328514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:26.329514 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.330856 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-a6f6d4b9-0d52-4557-9526-ac25a857e92c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:18:26.332241 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-a6f6d4b9-0d52-4557-9526-ac25a857e92c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.547662 Aug 04 21:18:26.332241 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Aug 4 21:18:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 21:18:26.340668 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ac72859c-d199-4e8e-9766-248b84b5cb91 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:26.367445 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-ac72859c-d199-4e8e-9766-248b84b5cb91 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031170 Aug 04 21:18:26.372150 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Aug 4 21:18:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:18:26.379700 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-914c50f5-2187-4422-95ee-d3e62fbb139b admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:26.406700 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-914c50f5-2187-4422-95ee-d3e62fbb139b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030458 Aug 04 21:18:26.407287 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Aug 4 21:18:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:18:26.419351 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ea7d2b1d-6945-435a-b67d-194a079ee9a1 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:26.426538 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.wsgi [None req-ea7d2b1d-6945-435a-b67d-194a079ee9a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ea7d2b1d-6945-435a-b67d-194a079ee9a1 admin admin] Request method failure captured: Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Accept: application/json Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Accept-Encoding: gzip, deflate Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Connection: keep-alive Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Content-Length: 0 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Host: 10.222.0.25 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Openstack-Api-Version: compute 2.90 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Openstack-System-Scope: None Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: User-Agent: python-novaclient Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Auth-Token: gAAAAABi7Dehr2VwXD5bPzH3RGEHrBCQ_TleKnhrqfo-JtEG8rmWH8JkhHP42FHPij9XZZ-5aRRJkCWyKYY62nU-Fpv5qAkvWjZtUGuz4zNpt6fso1WNTUfwSDbWQ7Vnb_Ps7WjyJp8DI3O7Vfo05VvY5RMT8xWXClqgx10293fNGM5BKino5x8 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Domain-Id: None Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Domain-Name: None Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Identity-Status: Confirmed Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Is-Admin-Project: True Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Domain-Id: default Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Domain-Name: Default Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Name: admin Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Role: admin,member,reader Aug 04 21:18:26.431038 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Roles: admin,member,reader Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6da47929012341928c673a2e0d1e97f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant: admin Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant-Name: admin Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User: admin Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Domain-Id: default Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Domain-Name: Default Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Id: bc6bad33dfb24427b1ccf30de722b45a Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Name: admin Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: method: > Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: exception: Flavor 42 could not be found. Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: action_args: {'id': '42'} Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:18:26.436806 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:26.438545 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:26.441089 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-ea7d2b1d-6945-435a-b67d-194a079ee9a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:18:26.442548 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-ea7d2b1d-6945-435a-b67d-194a079ee9a1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017545 Aug 04 21:18:26.442548 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Aug 4 21:18:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 21:18:27.578457 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-914c50f5-2187-4422-95ee-d3e62fbb139b admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:27.579522 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-914c50f5-2187-4422-95ee-d3e62fbb139b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 04 21:18:27.579934 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:28.305245 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-be366b7a-cb91-45a7-8f03-71f6db4ebf9b admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:28.312792 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.wsgi [None req-be366b7a-cb91-45a7-8f03-71f6db4ebf9b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-be366b7a-cb91-45a7-8f03-71f6db4ebf9b admin admin] Request method failure captured: Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Accept: application/json Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Accept-Encoding: gzip, deflate Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Connection: keep-alive Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Content-Length: 0 Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Host: 10.222.0.25 Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Openstack-Api-Version: compute 2.90 Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Openstack-System-Scope: None Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: User-Agent: python-novaclient Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Auth-Token: gAAAAABi7DejiDXMg20VF9_HeUa_ic_2AIGpvy2GKHuWZO7KUhGSerQaCBtGg32dzwRLRpwTTwXeNPpmv91I487lG5JhH6QYlD2Z1tHau8YeTOzrClEgO5sMs-YPZyz1NVyMYrdMrfrEpCF4GRS5wp9P8OXufuY7lqx1Cf1UnUDjoxvLvI-Fwew Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Domain-Id: None Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Domain-Name: None Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Identity-Status: Confirmed Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Is-Admin-Project: True Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Domain-Id: default Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Domain-Name: Default Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Name: admin Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Role: admin,member,reader Aug 04 21:18:28.314360 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Roles: admin,member,reader Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6da47929012341928c673a2e0d1e97f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant: admin Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant-Name: admin Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User: admin Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Domain-Id: default Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Domain-Name: Default Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Id: bc6bad33dfb24427b1ccf30de722b45a Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Name: admin Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: method: > Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: exception: Flavor 84 could not be found. Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: action_args: {'id': '84'} Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:18:28.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:28.318749 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.321607 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-be366b7a-cb91-45a7-8f03-71f6db4ebf9b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:18:28.324170 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-be366b7a-cb91-45a7-8f03-71f6db4ebf9b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.580080 Aug 04 21:18:28.324170 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Aug 4 21:18:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 581 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:28.328101 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-0bf34bce-1bfc-4d22-bb96-3307d76fa167 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:28.344450 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-0bf34bce-1bfc-4d22-bb96-3307d76fa167 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020330 Aug 04 21:18:28.345032 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Aug 4 21:18:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:18:28.355674 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-2accb8d3-6fcb-43b7-ad36-bbfcf50fd4ef admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:28.377393 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-2accb8d3-6fcb-43b7-ad36-bbfcf50fd4ef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025750 Aug 04 21:18:28.377986 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Aug 4 21:18:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:18:28.388606 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-2bb088a6-cece-4d13-a859-01ef1ac1e7aa admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:28.394949 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.wsgi [None req-2bb088a6-cece-4d13-a859-01ef1ac1e7aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-2bb088a6-cece-4d13-a859-01ef1ac1e7aa admin admin] Request method failure captured: Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Accept: application/json Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Accept-Encoding: gzip, deflate Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Connection: keep-alive Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Content-Length: 0 Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Host: 10.222.0.25 Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Openstack-Api-Version: compute 2.90 Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Openstack-System-Scope: None Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: User-Agent: python-novaclient Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Auth-Token: gAAAAABi7DejiDXMg20VF9_HeUa_ic_2AIGpvy2GKHuWZO7KUhGSerQaCBtGg32dzwRLRpwTTwXeNPpmv91I487lG5JhH6QYlD2Z1tHau8YeTOzrClEgO5sMs-YPZyz1NVyMYrdMrfrEpCF4GRS5wp9P8OXufuY7lqx1Cf1UnUDjoxvLvI-Fwew Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Domain-Id: None Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Domain-Name: None Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Identity-Status: Confirmed Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Is-Admin-Project: True Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Domain-Id: default Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Domain-Name: Default Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Name: admin Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Role: admin,member,reader Aug 04 21:18:28.396566 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Roles: admin,member,reader Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6da47929012341928c673a2e0d1e97f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant: admin Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant-Name: admin Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User: admin Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Domain-Id: default Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Domain-Name: Default Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Id: bc6bad33dfb24427b1ccf30de722b45a Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Name: admin Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: method: > Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: exception: Flavor 84 could not be found. Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: action_args: {'id': '84'} Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:18:28.398350 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:28.399656 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:28.401400 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-2bb088a6-cece-4d13-a859-01ef1ac1e7aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:18:28.402679 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-2bb088a6-cece-4d13-a859-01ef1ac1e7aa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013403 Aug 04 21:18:28.402679 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Aug 4 21:18:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:29.615144 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-2accb8d3-6fcb-43b7-ad36-bbfcf50fd4ef admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:29.616894 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-2accb8d3-6fcb-43b7-ad36-bbfcf50fd4ef admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002505 Aug 04 21:18:29.617711 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:30.366870 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-fe724385-4d13-469e-af4a-b92e3d9bdf2c admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:30.377890 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.wsgi [None req-fe724385-4d13-469e-af4a-b92e3d9bdf2c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-fe724385-4d13-469e-af4a-b92e3d9bdf2c admin admin] Request method failure captured: Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Accept: application/json Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Accept-Encoding: gzip, deflate Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Connection: keep-alive Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Content-Length: 0 Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Host: 10.222.0.25 Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Openstack-Api-Version: compute 2.90 Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Openstack-System-Scope: None Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: User-Agent: python-novaclient Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Auth-Token: gAAAAABi7Del9fqzQ2hFatj38kt2olrM-lf-FhJHW6dYCBr2DPhyzaMmCZM_sopXqG7nCQPq8vvI5nu56lZIlmluHDFf5gz9fESylbKYcWtNZDFKl6ttQ0hDYbq_VzHJQ2G7S4akwyX86zNk6W2piHe4V2VF_9p9GBVuTw0wMf6RWPDVvW-sKGQ Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Domain-Id: None Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Domain-Name: None Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Identity-Status: Confirmed Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Is-Admin-Project: True Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Domain-Id: default Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Domain-Name: Default Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Project-Name: admin Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Role: admin,member,reader Aug 04 21:18:30.381199 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Roles: admin,member,reader Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6da47929012341928c673a2e0d1e97f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant: admin Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-Tenant-Name: admin Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User: admin Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Domain-Id: default Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Domain-Name: Default Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Id: bc6bad33dfb24427b1ccf30de722b45a Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: X-User-Name: admin Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: method: > Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: exception: Flavor 451 could not be found. Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: action_args: {'id': '451'} Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:18:30.383049 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:30.385492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.387435 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-fe724385-4d13-469e-af4a-b92e3d9bdf2c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:18:30.388878 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-fe724385-4d13-469e-af4a-b92e3d9bdf2c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.570666 Aug 04 21:18:30.388878 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Aug 4 21:18:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 573 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:30.396069 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-b056677c-c27f-402b-8298-55ed011ae7ef admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:30.417098 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-b056677c-c27f-402b-8298-55ed011ae7ef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024687 Aug 04 21:18:30.417664 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Aug 4 21:18:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:18:30.429278 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:30.448172 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023777 Aug 04 21:18:30.448743 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Aug 4 21:18:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:18:30.461695 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4f8baf87-c351-4b30-8a64-06fd67a38823 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:30.467805 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.wsgi [None req-4f8baf87-c351-4b30-8a64-06fd67a38823 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4f8baf87-c351-4b30-8a64-06fd67a38823 admin admin] Request method failure captured: Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Accept: application/json Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Accept-Encoding: gzip, deflate Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Connection: keep-alive Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Content-Length: 0 Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Host: 10.222.0.25 Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Openstack-Api-Version: compute 2.90 Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Openstack-System-Scope: None Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: User-Agent: python-novaclient Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Auth-Token: gAAAAABi7Del9fqzQ2hFatj38kt2olrM-lf-FhJHW6dYCBr2DPhyzaMmCZM_sopXqG7nCQPq8vvI5nu56lZIlmluHDFf5gz9fESylbKYcWtNZDFKl6ttQ0hDYbq_VzHJQ2G7S4akwyX86zNk6W2piHe4V2VF_9p9GBVuTw0wMf6RWPDVvW-sKGQ Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Domain-Id: None Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Domain-Name: None Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Identity-Status: Confirmed Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Is-Admin-Project: True Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Domain-Id: default Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Domain-Name: Default Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Project-Name: admin Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Role: admin,member,reader Aug 04 21:18:30.469362 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Roles: admin,member,reader Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6da47929012341928c673a2e0d1e97f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6da47929012341928c673a2e0d1e97f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant: admin Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant-Id: 6da47929012341928c673a2e0d1e97f0 Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-Tenant-Name: admin Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User: admin Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Domain-Id: default Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Domain-Name: Default Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Id: bc6bad33dfb24427b1ccf30de722b45a Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: X-User-Name: admin Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: method: > Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: exception: Flavor 451 could not be found. Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: action_args: {'id': '451'} Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:18:30.471724 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:30.473240 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: ERROR nova.api.openstack.wsgi Aug 04 21:18:30.475293 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4f8baf87-c351-4b30-8a64-06fd67a38823 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:18:30.477014 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-4f8baf87-c351-4b30-8a64-06fd67a38823 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015375 Aug 04 21:18:30.477014 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Aug 4 21:18:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 21:18:31.528904 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:31.529920 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 04 21:18:31.530327 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:32.167961 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-8e390a1a-4055-45d6-9fce-27f5e9c82a92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:18:32.288746 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-8e390a1a-4055-45d6-9fce-27f5e9c82a92 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.620566 Aug 04 21:18:32.289298 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Aug 4 21:18:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:18:33.346007 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:33.347029 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 04 21:18:33.347470 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:33.931046 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-5fe38ccc-39a8-4732-ba83-fb409f278b6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:18:34.065415 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-5fe38ccc-39a8-4732-ba83-fb409f278b6a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.575421 Aug 04 21:18:34.065880 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Aug 4 21:18:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:18:35.088973 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:35.090043 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 04 21:18:35.090440 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:35.665939 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-89af7042-2700-4c49-aa56-3664ab2687cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:18:35.807532 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-89af7042-2700-4c49-aa56-3664ab2687cf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.576797 Aug 04 21:18:35.808005 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Aug 4 21:18:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:18:36.825492 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:36.826532 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 04 21:18:36.826923 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:37.407510 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-091c7805-a0c1-408c-8197-2bdecd0a5672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:18:37.545527 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-091c7805-a0c1-408c-8197-2bdecd0a5672 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.569505 Aug 04 21:18:37.546029 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Aug 4 21:18:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:18:38.568091 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:38.569105 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 21:18:38.569499 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:18:39.193192 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-4ded1d01-5fd0-40bc-9762-bf78ec1ee22c admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:18:39.219694 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-4ded1d01-5fd0-40bc-9762-bf78ec1ee22c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.509183 Aug 04 21:18:39.220261 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Aug 4 21:18:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:19:36.232150 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:19:36.233287 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-dbae2775-0a13-4ca1-9e1c-6f89170953dc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 04 21:19:36.233815 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Thu Aug 4 21:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:19:36.245588 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:36.694071 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-11b17eb9-852a-4c67-acbe-89a7b3c9c31f admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:19:36.716044 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-11b17eb9-852a-4c67-acbe-89a7b3c9c31f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.475395 Aug 04 21:19:36.716603 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Aug 4 21:19:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:19:36.738009 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG dbcounter [-] [103999] Writing DB stats nova_api:SELECT=14 {{(pid=103999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:36.741944 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-253f1c1d-42cc-44c6-b35d-06ea78241122 admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:19:36.750030 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-253f1c1d-42cc-44c6-b35d-06ea78241122 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013397 Aug 04 21:19:36.750597 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Aug 4 21:19:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:19:36.763762 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-c552b932-be0c-4998-8584-4a928d31fccd admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:19:36.772640 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-c552b932-be0c-4998-8584-4a928d31fccd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012598 Aug 04 21:19:36.774193 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Aug 4 21:19:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:19:36.786332 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:19:36.795293 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012763 Aug 04 21:19:36.795932 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Aug 4 21:19:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:19:36.811427 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-d4b52148-f67d-4c49-a764-fe1a42d4d568 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:19:36.821630 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-d4b52148-f67d-4c49-a764-fe1a42d4d568 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015590 Aug 04 21:19:36.822275 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Aug 4 21:19:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:23:03.801558 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:03.802595 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 04 21:23:03.803061 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:23:03.946267 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=6 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:23:04.134984 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:04.137379 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:23:04.137379 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: warnings.warn(msg) Aug 04 21:23:04.138515 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:04.138994 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:04.139448 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:04.140176 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:04.141210 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:04.141634 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:04.175573 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-65ff792f-1b81-4b55-9139-ec26ab7e093d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.230820 Aug 04 21:23:04.176146 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Aug 4 21:23:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:23:05.040961 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:05.042294 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001872 Aug 04 21:23:05.042742 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:23:05.250605 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:05.253128 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:23:05.253128 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: warnings.warn(msg) Aug 04 21:23:05.254273 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:05.254896 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:05.255361 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:05.256100 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:05.256551 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:05.256996 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:05.277617 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-80270429-0949-44af-bce8-2e60ef1e381d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091116 Aug 04 21:23:05.278112 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Aug 4 21:23:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:23:16.580568 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:16.581575 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 04 21:23:16.581974 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:23:16.728949 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell0:SELECT=4 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:23:16.730059 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_cell1:SELECT=4 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:23:16.730800 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG dbcounter [-] [103998] Writing DB stats nova_api:SELECT=8 {{(pid=103998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:23:16.783949 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:16.786363 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:23:16.786363 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: warnings.warn(msg) Aug 04 21:23:16.787596 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:16.788010 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:16.788442 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:16.789150 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:16.789594 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:16.790009 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:16.815697 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-80b496ac-0cc9-472f-9924-6f3991c8793e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091334 Aug 04 21:23:16.816346 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Aug 4 21:23:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:23:17.674261 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: DEBUG nova.api.openstack.wsgi [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] Calling method '>' {{(pid=103999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:17.675266 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: INFO nova.api.openstack.requestlog [None req-8679328a-a18d-47ab-b3d6-cfe4857099ce admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 04 21:23:17.675704 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: [pid: 103999|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Aug 4 21:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:23:17.874871 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG nova.api.openstack.wsgi [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Calling method '>' {{(pid=103998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:23:17.877844 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:23:17.877844 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: warnings.warn(msg) Aug 04 21:23:17.879090 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:17.879587 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:17.880024 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:17.880737 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:23:17.881188 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:23:17.881603 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: DEBUG oslo_concurrency.lockutils [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:23:17.904497 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: INFO nova.api.openstack.requestlog [None req-cc0b6997-3042-458b-98af-42eb9461be38 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087135 Aug 04 21:23:17.905057 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: [pid: 103998|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Aug 4 21:23:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:24:16.642255 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: Thu Aug 4 21:24:16 2022 - graceful shutdown triggered... Aug 04 21:24:16.643638 dv-cinder-852208-1-iscsi devstack@n-api.service[103998]: Gracefully killing worker 1 (pid: 103998)... Aug 04 21:24:16.644037 dv-cinder-852208-1-iscsi devstack@n-api.service[103999]: Gracefully killing worker 2 (pid: 103999)... Aug 04 21:24:16.644657 dv-cinder-852208-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 21:24:17.644844 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: worker 1 buried after 1 seconds Aug 04 21:24:17.644844 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: worker 2 buried after 1 seconds Aug 04 21:24:17.644844 dv-cinder-852208-1-iscsi devstack@n-api.service[103997]: goodbye to uWSGI. Aug 04 21:24:17.646729 dv-cinder-852208-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 21:24:17.647287 dv-cinder-852208-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 21:24:17.650152 dv-cinder-852208-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 21:24:17.661383 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 21:24:17 2022] *** Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: nodename: dv-cinder-852208-1-iscsi Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: machine: x86_64 Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: clock source: unix Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: pcre jit disabled Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: detected number of CPU cores: 4 Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: current working directory: / Aug 04 21:24:17.663412 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: detected binary path: /usr/bin/uwsgi-core Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: your processes number limit is 47680 Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: your memory page size is 4096 bytes Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: detected max file descriptor number: 2048 Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: lock engine: pthread robust mutexes Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: thunder lock: enabled Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 21:24:17.664178 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 21:24:17.706136 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: Python main interpreter initialized at 0x55cfc902d9c0 Aug 04 21:24:17.706136 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: python threads support enabled Aug 04 21:24:17.706136 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: your server socket listen backlog is limited to 100 connections Aug 04 21:24:17.706136 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: your mercy for graceful operations on workers is 90 seconds Aug 04 21:24:17.706706 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 21:24:17.706706 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: *** Operational MODE: preforking *** Aug 04 21:24:17.706950 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: *** uWSGI is running in multiple interpreter mode *** Aug 04 21:24:17.706950 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: spawned uWSGI master process (pid: 118534) Aug 04 21:24:17.716045 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: spawned uWSGI worker 1 (pid: 118549, cores: 1) Aug 04 21:24:17.716045 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: spawned uWSGI worker 2 (pid: 118550, cores: 1) Aug 04 21:24:17.716045 dv-cinder-852208-1-iscsi devstack@n-api.service[118534]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 21:24:17.707155 dv-cinder-852208-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 21:24:18.415250 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:24:18.424531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 21:24:19.627947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:24:19.627947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: from cryptography.utils import int_from_bytes Aug 04 21:24:19.628723 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:24:19.628723 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: from cryptography.utils import int_from_bytes Aug 04 21:24:19.667289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:24:19.667289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: from cryptography.utils import int_from_bytes Aug 04 21:24:19.668156 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:24:19.668156 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: from cryptography.utils import int_from_bytes Aug 04 21:24:22.028505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:24:22.030990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:24:22.030990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:24:22.030990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:24:22.030990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:24:22.030990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.030990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.031880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.031880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.032276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.032276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.033853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.033853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.033853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.034837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.034837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.034837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-1-iscsi {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.035866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.035866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.035866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.036495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.036495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.036889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.036889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.037319 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.039186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.039583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.039968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.040334 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.040644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.041033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.041376 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.041642 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.041944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.042250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.042732 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-1-iscsi {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.043003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.043349 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.043738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.044101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.044413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.044737 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.045065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.045405 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.045711 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.046046 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.046378 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.046705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.047030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.047358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.047680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.049625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.049625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.049625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.049625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.050271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.050271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.050549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.050695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.051057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.051263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.051566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.051895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.052222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.052536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.052846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.053157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.053468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.053779 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.054089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.054407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.054716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.055042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.055383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.055715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.056063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.056441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.056854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.057110 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.057423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.057770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.059171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.059171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.059171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.059171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.060190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.060190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.060190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.060841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.060841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.061570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.061815 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.063234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.063234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.063234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.063234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.063234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.064222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.064222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.064222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.065159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.065159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.065455 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.065604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.065808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.066118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.066429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.066736 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.067068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.067436 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.067750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.068114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.069666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.069666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.069666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.069666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.069666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.071844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.072809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.072809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.072809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.073271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.073420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.073761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.074002 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.074297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.074733 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.075471 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.075471 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.075860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.075860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.076302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.076531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.076786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.077029 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.077339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.077682 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.078020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.078364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.078688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.079116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.080143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.080143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.080143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.080700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.080700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.081057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.081261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.081835 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.082045 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.082251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.082515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.082834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.083159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.083500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.083816 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.084136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.085065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.085065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.085678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.085678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.085956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.086096 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.086378 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.086707 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.087031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.087431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.087749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.088076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.088414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.088729 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.089142 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.089389 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.090364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.090364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.090364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.090783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.091104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.091248 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.091556 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.091910 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.092140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.092456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.092771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.093083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.093392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.093701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.094008 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.094320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.094632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.094956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.096139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.096139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.096583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.096804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.097120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.097431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.097744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.098054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.098373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.098686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.098995 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.099382 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.099704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.099965 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.100410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.100599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.100909 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.101227 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.101540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.101855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.102171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.102486 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.102816 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.103134 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.103486 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.103897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.104158 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.104466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.104794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.105129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.105452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.105758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.106073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.106380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.106853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.107044 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.107391 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.107690 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.107994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.108301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.108609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.108915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.109241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.109556 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.109860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.110170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.110712 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.110877 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.111095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.112072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.112444 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.112842 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.113138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.113513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.113791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.114252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.114404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.114684 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.114996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.115507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.115689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.115981 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.116287 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.116611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.117063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.117232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.117538 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.117856 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.118198 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.118536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.118859 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.119184 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.119645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.119912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.120155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.120470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.120954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.121320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.121598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.121912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.122237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.122546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.122873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.123188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.123535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.123844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.124158 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.124494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.124828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.125308 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.125693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.126037 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.126268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.126584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.127509 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.127912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.128260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.128538 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.128920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.129238 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.129546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.129944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.130162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.130469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.130775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.131120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.131472 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.131805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.132122 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.132447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.132772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.133079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.133423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.133750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.134065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.134365 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.134675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.134979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.135349 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.135690 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.135973 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.136291 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.136615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.136907 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.137230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.137536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.137921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.138206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.138544 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.138788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.139099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.139437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.139751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.140063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.140390 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.140700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.141020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.141340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.141637 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.141953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.142270 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.143448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.143783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.144103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.144426 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.144748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.145193 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.145547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.145852 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.151228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.153720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.154875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.154875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.154875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.155222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.155359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.155674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.156010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.156321 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.156680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.156938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.157326 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.157796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.158024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.158484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.158484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.158796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.159108 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.159442 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.159756 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.160064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.160381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.160693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.160997 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.161306 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.161620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.161923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.162230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.162541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.162846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.163161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.163493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.163800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.164121 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.164509 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.164714 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.165020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.165356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.165669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.165974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.166280 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.166597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.166897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.167203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.167541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.167867 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.168189 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.168501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.168810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.169117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.169423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.169731 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.170041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.170346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.170654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.170960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.171337 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.171597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.171927 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.172478 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.172625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.172837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.173144 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.173490 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.173825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.174188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.174503 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.174817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.175144 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.175484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.175798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.176113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.176423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.176739 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.177051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.177368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.177678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.177983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.178311 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.178623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.178935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.179257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.179611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.179945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.180778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.180778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.180935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.181145 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.181456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.181768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.182259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.182446 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.183639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.183639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.183639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.183639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.184204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.184204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.184504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.184901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.185111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.186253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.186253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.186253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.186912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.186912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.187285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.187652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.187963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.188770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.188770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.189062 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.189922 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.190262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.190366 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.190763 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.191028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.191388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.191674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.191982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.192380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.192597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.192925 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.193229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.193632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.193843 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.194167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.194514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.194847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.195263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.195913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.195913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.196330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.196640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.196952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.197380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.197677 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.198002 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.198309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.198960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.198960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.199431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.199837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.199980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.200406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.200406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.200847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.201094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.201408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.201737 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.202167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.203117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.203117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.203524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.203524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.203805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.204115 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.204431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.204737 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.205641 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.205975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.206284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.206596 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.206905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.207215 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.207579 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.207852 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.208178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.208482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.208806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.209126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.209474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.209791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.210100 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.210429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.210741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.211043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.211368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.211677 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.212022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.212331 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.212700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.213088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.213522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.213737 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.214001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.214330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.214648 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.214964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.215284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.215738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.216025 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.216338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.216643 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.216953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.217255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.217561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.217866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.218180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.218490 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.218812 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.219120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.219467 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.219778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.220089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.220398 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.220740 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.221152 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.221457 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.221789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.222105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.222432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.222824 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.223064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.223406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.223726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.224070 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.224393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.224709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.225022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.225342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.225663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.225984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.226561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.226826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:24:22.227352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.227510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:24:22.227655 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.227655 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.227939 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:24:22.228089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.228268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:24:22.228496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.228742 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:24:22.228742 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.229172 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.229389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.229554 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.229713 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.229966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.230129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.230284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.230430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.230583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.230784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.230942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.231088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.231232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.231424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.231696 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.231860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.232060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.232330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-1-iscsi {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.232603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.232847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.233007 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.233213 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.233378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.233677 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.233929 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.234230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.234472 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.234634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.234788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.234992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.235197 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.235375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.235546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.235721 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.235866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.236009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.236151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.236323 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.236767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.236953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.237691 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.237866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.237978 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.238122 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.238278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.238423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.238576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.238714 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.238875 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.238985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.238985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.239419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.239588 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.239741 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.239842 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.239959 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-1-iscsi {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.240047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.240138 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.240281 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.240426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.240568 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.240747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.240912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.241232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.241339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.241551 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.241775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.241877 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.242192 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.242313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.242506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.242799 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.242905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.243145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.243495 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.243778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.243904 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.244118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.244303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.244436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.244730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.244879 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.245053 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.245362 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.245452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.245812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.245987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.246140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.246287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.246469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.246609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.246902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.247078 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.247221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.247490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.247642 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.247794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.248090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.249190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.249901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.250112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.250234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.250234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.250667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.250823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.250972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.251117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.251256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.251390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.251545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.251685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.252342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.252519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.252698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.252860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.252966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.253054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.253150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.253237 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.253237 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.253237 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.253479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.253566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.253566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.253732 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.254029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.254154 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.254243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.254402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.254524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.254765 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.254931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.255078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.255429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.255528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.255756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.255981 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.256078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.256432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.256534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.256749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.257059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.257195 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.257444 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.258284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.258370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.258370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.258530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.258603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.258778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.258858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.259112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.259667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.260192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.263089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.263089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.263340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.263439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.263523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.263619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.263715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.263809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.263900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.263986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.264070 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.264155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.264254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.264340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.264464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.264625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.264768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.264768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.264768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.264768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.265314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.265314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.265590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.266173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.266173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.266495 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.266822 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.267134 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.267532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.268366 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.268597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.268831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.269076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.269326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.269569 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.269801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.269801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.270272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.270509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.270751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.271003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.271237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.271524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.271524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.271975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.272225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.272450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.272674 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.272916 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.273141 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.273430 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.273836 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.274088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.274359 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.274852 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.275093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.275523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.275761 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.276060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.276441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.276441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.276896 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.277154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.277381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.277613 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.277848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.278107 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.278449 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.278764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.278764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.279234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.279522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.279758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.280015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.280262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.280497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.280497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.280944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.281177 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:24:22.281177 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.281662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.281891 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.282119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.282352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.282589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.282844 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.283079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.283388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.283630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.283902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.284309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.284583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.285101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.285344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.285750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.285985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.286246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.286628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.286876 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.287338 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.287577 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.287812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.288059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.288308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.288570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.288812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.289060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.289279 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.289519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.289750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.289985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.290215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.290454 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.290700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.290921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.291139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.291425 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.291672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.291916 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.292158 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.292367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.292620 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.292844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.293119 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.293362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.293771 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.294010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.294273 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.294676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.294948 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.295554 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.296033 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.296286 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.296521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.296521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.297120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.297120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.297574 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.297574 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.297574 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.298252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.298509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.298765 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.298765 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.299388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.299619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.299866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.300387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.300643 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.300892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.301124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.301371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.301605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.301854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.302100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.302100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.302570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.302805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.303052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.303283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.303539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.303768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.303990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.304228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.304460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.304726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.305120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.305677 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.305922 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.306347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.306576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.306845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.306845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.307457 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.307705 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.307937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.307937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.308478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.308478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.308921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.309152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.309394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.309636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.309885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.310117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.310339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.310582 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.310816 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.311397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.311634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.311870 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.312114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.312370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.312613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.312858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.313103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.313325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.313563 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.313794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.313794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.314735 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.314991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.315428 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.315947 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.316186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.316623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.316861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.317087 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.317450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.317671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.317902 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.318155 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.318407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.318643 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.318885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.319130 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.319432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.319432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.319912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.320146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.320395 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.320395 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.320862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.321106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.321343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.321574 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.321859 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.322078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.322304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.322523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.322748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.322940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.323169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.323411 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.323651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.323878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.324105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.324315 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.324533 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.324760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.324989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.325218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.325660 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.326232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.326469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.326916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.327164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.327427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.327796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.328026 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.328264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.328515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.328734 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.328949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.329186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.329427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.329680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.330588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.330911 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.331159 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.331439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.331694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.331937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.332159 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.332159 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.332159 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.332803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.333051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.333330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.333330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.333795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.333795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.334266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.334532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.335015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.335283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.335701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.336480 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.336972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.336972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.337611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.338065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.338065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.338525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.338789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.339031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.339265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.339265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.339750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.340012 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.340274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.340512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.340745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.341022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.341274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.341523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.341756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.341999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.342245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.342504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.342758 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.343030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.343287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.343663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.343913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.344245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.344518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.345014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.345263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.345539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.345790 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.346043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.346330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.347201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.347656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.347923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.348340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.348587 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.348854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.348854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.349337 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.349593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.349854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.350101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.350513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.350761 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.351215 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.351511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.351771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.352036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.352295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.352577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.353209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.353455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.353455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.353934 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354203 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354454 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.354694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.356569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.359335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.361228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.363016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.364885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.367863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.369912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.371679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.373517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.375264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.377926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.380371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.382084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.383908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.385695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.387477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.390151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.391969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.394378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.396170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.397878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.400527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.402148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.403815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.405396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.406975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.409374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.411587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.413427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.415256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.417102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.423105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.425507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.427307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.429117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.431796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.433578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.435486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.437454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.440566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.442332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.444123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.445806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.447709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.449553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.452253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.453906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.455646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.457213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.458926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.461510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.463436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.465540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.467623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.469457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.472254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.474074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.475949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.477913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.480072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.482594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.484433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.486656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.486656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.486656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.486656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.486656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.486656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.488157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.488157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.488157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.488157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.488157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.489328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.489328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.489328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.489328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.490255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.490255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.490255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.490955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.490955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.491734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.491734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.492594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.492594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.492594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.493249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.493496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.493738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.494001 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:24:22.494258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:24:22.499629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO dbcounter [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Registered counter for database nova_api Aug 04 21:24:22.521991 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_db.sqlalchemy.engines [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.530942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writer thread running {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.597155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.context [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),276ce854-5a06-42fd-a4c0-ee9620cd609a(cell1) {{(pid=118549) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:24:22.601426 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:24:22.601903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:24:22.603610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:24:22.604370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:24:22.604817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:24:22.606826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:24:22.609859 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO dbcounter [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Registered counter for database nova_cell0 Aug 04 21:24:22.615579 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO dbcounter [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Registered counter for database nova_cell1 Aug 04 21:24:22.623361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_db.sqlalchemy.engines [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.624894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_db.sqlalchemy.engines [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.632960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writer thread running {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.633302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writer thread running {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.658749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO dbcounter [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Registered counter for database nova_api Aug 04 21:24:22.681008 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_db.sqlalchemy.engines [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.688574 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writer thread running {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.746699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.context [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),276ce854-5a06-42fd-a4c0-ee9620cd609a(cell1) {{(pid=118550) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 21:24:22.750909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:24:22.751405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:24:22.753749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:24:22.754508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:24:22.754950 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:24:22.756992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:24:22.759065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO dbcounter [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Registered counter for database nova_cell0 Aug 04 21:24:22.763370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO dbcounter [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Registered counter for database nova_cell1 Aug 04 21:24:22.771822 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_db.sqlalchemy.engines [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.773187 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_db.sqlalchemy.engines [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.780101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writer thread running {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.781476 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writer thread running {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.789894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO dbcounter [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Registered counter for database nova_cell0 Aug 04 21:24:22.799728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_db.sqlalchemy.engines [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.804506 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writer thread running {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:22.936436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO dbcounter [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Registered counter for database nova_cell0 Aug 04 21:24:22.946599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_db.sqlalchemy.engines [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:24:22.951880 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writer thread running {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:24:23.136956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: WARNING keystonemiddleware.auth_token [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:24:23.144975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: WARNING keystonemiddleware.auth_token [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:24:23.296094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: WARNING keystonemiddleware.auth_token [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:24:23.304719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: WARNING keystonemiddleware.auth_token [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:24:23.492457 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: WARNING keystonemiddleware.auth_token [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:24:23.498845 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: WARNING keystonemiddleware.auth_token [None req-e39efc71-0669-4e22-a927-44a7fc148175 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:24:23.506656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfc902d9c0 pid: 118549 (default app) Aug 04 21:24:23.652077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: WARNING keystonemiddleware.auth_token [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 21:24:23.658315 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: WARNING keystonemiddleware.auth_token [None req-82d14a2f-3619-48e7-9956-672ecc09b945 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 21:24:23.664700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfc902d9c0 pid: 118550 (default app) Aug 04 21:25:01.953409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=3 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:01.954277 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=3 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:01.955030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=3 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:01.955789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=3 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:03.148851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-60a8e1a2-3864-4eae-8b5d-e38fbcc6ce25 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Action: 'create', calling method: .version_select at 0x7f8e72edce50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-817120722"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:05.499898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-60a8e1a2-3864-4eae-8b5d-e38fbcc6ce25 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.570684 Aug 04 21:25:05.504122 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Aug 4 21:25:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3576 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 21:25:05.525509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:05.536863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:05.543607 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:05.547850 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:05.987514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3c78a993-6300-4159-bc35-fdd3c038bab3 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72e9e9d0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:06.570152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3c78a993-6300-4159-bc35-fdd3c038bab3 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 200 len: 344 microversion: 2.1 time: 1.054796 Aug 04 21:25:06.576844 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:05 2022] GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 344 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:07.586243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6e748ef6-95d8-4eb6-8551-3c888208b755 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72ca5ca0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:07.678224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6e748ef6-95d8-4eb6-8551-3c888208b755 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 200 len: 345 microversion: 2.1 time: 0.089746 Aug 04 21:25:07.685788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-615d04a3-6056-41f7-929c-d0973688be8b tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Action: 'create', calling method: .version_select at 0x7f8e72ce0e50>, body: {"snapshot": {"volume_id": "1bd3d3b4-ea46-4b3b-a8e8-007d88676506", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-4405863"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:07.686649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:07 2022] GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:25:08.411625 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-615d04a3-6056-41f7-929c-d0973688be8b tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 284 microversion: 2.1 time: 0.730513 Aug 04 21:25:08.412840 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 2/4] 10.222.0.25 () {60 vars in 1162 bytes} [Thu Aug 4 21:25:07 2022] POST /compute/v2.1/os-snapshots => generated 284 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:08.426877 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-793a4707-d221-4ae1-b5f4-abcbf624dac6 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cba3a0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:08.591488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-793a4707-d221-4ae1-b5f4-abcbf624dac6 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 200 len: 284 microversion: 2.1 time: 0.169391 Aug 04 21:25:08.592377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:08 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:08.604057 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8f30238a-2847-47cd-aa5b-6f4e0103f5b2 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72ce0af0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:08.707764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8f30238a-2847-47cd-aa5b-6f4e0103f5b2 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.107827 Aug 04 21:25:08.708994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Aug 4 21:25:08 2022] GET /compute/v2.1/os-snapshots => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:08.720974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3f177bdc-3bab-4aae-9dd8-e78a8cedf580 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cbaaf0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:08.786727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3f177bdc-3bab-4aae-9dd8-e78a8cedf580 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 200 len: 284 microversion: 2.1 time: 0.069941 Aug 04 21:25:08.787482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:08 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 284 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:09.804735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ec9c5f41-a5e7-45ed-850a-fb8cb674fffc tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cbec10>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:09.889781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ec9c5f41-a5e7-45ed-850a-fb8cb674fffc tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 200 len: 284 microversion: 2.1 time: 0.094180 Aug 04 21:25:09.900054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:09 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:10.920869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-da238e78-a363-4ff5-b610-bef0297ca21f tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72ca5d30>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:11.026928 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-da238e78-a363-4ff5-b610-bef0297ca21f tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 200 len: 284 microversion: 2.1 time: 0.123334 Aug 04 21:25:11.028765 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:10 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:12.041207 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-130e9399-e450-4b9c-961b-0e05eb566428 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cbe820>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:12.115650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-130e9399-e450-4b9c-961b-0e05eb566428 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 200 len: 285 microversion: 2.1 time: 0.078225 Aug 04 21:25:12.132109 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:12 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:12.132909 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6ea241d8-83e1-4418-a5f3-738de8113b9c tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cbaa60>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:12.710241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6ea241d8-83e1-4418-a5f3-738de8113b9c tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 202 len: 0 microversion: 2.1 time: 0.571372 Aug 04 21:25:12.713292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Aug 4 21:25:12 2022] DELETE /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:25:12.718260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-20767697-845f-42e8-8556-a9f8aaf7fca8 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cbe280>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:12.805726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-20767697-845f-42e8-8556-a9f8aaf7fca8 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 200 len: 284 microversion: 2.1 time: 0.099200 Aug 04 21:25:12.817789 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:12 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:13.826740 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ebe19522-dece-42d0-8ebe-75542af441e4 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72cba3a0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:13.872864 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-ebe19522-dece-42d0-8ebe-75542af441e4 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] HTTP exception thrown: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ebe19522-dece-42d0-8ebe-75542af441e4 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Request method failure captured: Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d HTTP/1.1 Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DktgtpW5UDMajIEBX92ckstkba6bEJ3QlD4R4RAtWC10dSOkq9tBcYBSqfwj5PWhH9CjONO5GXvVzMZ50rrAwoBtwQY93PrpxDbOwywy_WyTCqZUuRkdTJVnkBHiXC0xOjq4Y17sbs2TQycqPgSQkPSaVnWoG31WuFg9oiZTpta2Iw Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:13.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: f44c8dee7121485b81d22764abe990bc Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '99210e64-9869-4028-95f0-03fee1ae5d0d'} Aug 04 21:25:13.881182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. (HTTP 404) (Request-ID: req-1b070c21-d469-4ab3-bbb5-b21edcd16427) Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.881806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:13.882601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 21:25:13.885119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. Aug 04 21:25:13.886083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:13.888925 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ebe19522-dece-42d0-8ebe-75542af441e4 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Returning 404 to user: Snapshot 99210e64-9869-4028-95f0-03fee1ae5d0d could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:13.890073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ebe19522-dece-42d0-8ebe-75542af441e4 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d" status: 404 len: 111 microversion: 2.1 time: 0.069076 Aug 04 21:25:13.891227 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:25:13 2022] GET /compute/v2.1/os-snapshots/99210e64-9869-4028-95f0-03fee1ae5d0d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:25:13.903820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e27b3743-d770-4589-b94f-f7fffb020038 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72f06af0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:14.154671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e27b3743-d770-4589-b94f-f7fffb020038 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 202 len: 0 microversion: 2.1 time: 0.254978 Aug 04 21:25:14.166957 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-00485047-6499-4515-9764-e70d0c4f90d1 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72c23550>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:14.168025 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:25:13 2022] DELETE /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:25:14.359576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-00485047-6499-4515-9764-e70d0c4f90d1 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 200 len: 344 microversion: 2.1 time: 0.197512 Aug 04 21:25:14.367250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:14 2022] GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:15.338888 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-979386941", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:15.380084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b670c87-bec3-4bef-8d28-332a18f66959 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72c23c10>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:15.479421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-2b670c87-bec3-4bef-8d28-332a18f66959 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] HTTP exception thrown: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b670c87-bec3-4bef-8d28-332a18f66959 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Request method failure captured: Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 HTTP/1.1 Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DktgtpW5UDMajIEBX92ckstkba6bEJ3QlD4R4RAtWC10dSOkq9tBcYBSqfwj5PWhH9CjONO5GXvVzMZ50rrAwoBtwQY93PrpxDbOwywy_WyTCqZUuRkdTJVnkBHiXC0xOjq4Y17sbs2TQycqPgSQkPSaVnWoG31WuFg9oiZTpta2Iw Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:15.484451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: f44c8dee7121485b81d22764abe990bc Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '1bd3d3b4-ea46-4b3b-a8e8-007d88676506'} Aug 04 21:25:15.485593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. (HTTP 404) (Request-ID: req-1af1b3cb-36ef-44fa-9e83-b991b0387211) Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.486272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:15.487273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:25:15.489462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.491610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b670c87-bec3-4bef-8d28-332a18f66959 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Returning 404 to user: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:15.494522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2b670c87-bec3-4bef-8d28-332a18f66959 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 404 len: 109 microversion: 2.1 time: 0.121610 Aug 04 21:25:15.494522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:15 2022] GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:25:15.509497 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-17d37a56-41dc-4f10-9d9e-192fbe199e39 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72c234c0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:15.593234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] validate_networks() for [('31a74276-e1d0-48dd-b1d1-b4f0b9cf64fe', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:25:15.599693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-17d37a56-41dc-4f10-9d9e-192fbe199e39 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] HTTP exception thrown: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-17d37a56-41dc-4f10-9d9e-192fbe199e39 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Request method failure captured: Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 HTTP/1.1 Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DktgtpW5UDMajIEBX92ckstkba6bEJ3QlD4R4RAtWC10dSOkq9tBcYBSqfwj5PWhH9CjONO5GXvVzMZ50rrAwoBtwQY93PrpxDbOwywy_WyTCqZUuRkdTJVnkBHiXC0xOjq4Y17sbs2TQycqPgSQkPSaVnWoG31WuFg9oiZTpta2Iw Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:15.602685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: f44c8dee7121485b81d22764abe990bc Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '1bd3d3b4-ea46-4b3b-a8e8-007d88676506'} Aug 04 21:25:15.604112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. (HTTP 404) (Request-ID: req-d5028061-327e-4d0f-9dac-30b3ed94e7eb) Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.604932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:25:15.606051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:25:15.607132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.608354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-17d37a56-41dc-4f10-9d9e-192fbe199e39 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Returning 404 to user: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:15.609992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-17d37a56-41dc-4f10-9d9e-192fbe199e39 tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 404 len: 109 microversion: 2.1 time: 0.106554 Aug 04 21:25:15.611541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 10/17] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:25:15 2022] DELETE /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:25:15.632138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-efa61f14-3f0d-4916-810b-39ea40bc842a tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Calling method '.version_select at 0x7f8e72c23b80>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:15.703524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-efa61f14-3f0d-4916-810b-39ea40bc842a tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] HTTP exception thrown: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-efa61f14-3f0d-4916-810b-39ea40bc842a tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Request method failure captured: Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 HTTP/1.1 Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DktgtpW5UDMajIEBX92ckstkba6bEJ3QlD4R4RAtWC10dSOkq9tBcYBSqfwj5PWhH9CjONO5GXvVzMZ50rrAwoBtwQY93PrpxDbOwywy_WyTCqZUuRkdTJVnkBHiXC0xOjq4Y17sbs2TQycqPgSQkPSaVnWoG31WuFg9oiZTpta2Iw Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:15.706542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c97e87ed5cc4cd5b928e4b8e5be8053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9c97e87ed5cc4cd5b928e4b8e5be8053 Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941147049 Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: f44c8dee7121485b81d22764abe990bc Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941147049-project Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '1bd3d3b4-ea46-4b3b-a8e8-007d88676506'} Aug 04 21:25:15.707829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. (HTTP 404) (Request-ID: req-1d3ed5da-0f0a-4175-bf79-14ca2b3ccee1) Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.708481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:15.709354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:25:15.710201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-efa61f14-3f0d-4916-810b-39ea40bc842a tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] Returning 404 to user: Volume 1bd3d3b4-ea46-4b3b-a8e8-007d88676506 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:15.711093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-efa61f14-3f0d-4916-810b-39ea40bc842a tempest-VolumesSnapshotsTestJSON-941147049 tempest-VolumesSnapshotsTestJSON-941147049-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506" status: 404 len: 109 microversion: 2.1 time: 0.094115 Aug 04 21:25:15.711787 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 11/18] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:15 2022] GET /compute/v2.1/os-volumes/1bd3d3b4-ea46-4b3b-a8e8-007d88676506 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:25:17.930983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-da39210c-b5c8-4acf-8cc4-2bbb3d424acb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'create', calling method: .version_select at 0x7f8e72c23160>, body: {"keypair": {"name": "tempest-keypair-650827798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYfAtW+C5lgh+5Dnq4OP5VjSl1l/JlVGqFgkLb74i+Q4xzUxVZRyNq5S/e66287Kd6jkRV22Pn9g5D7MAwM/Otn35ld1FgrwzGjR5DREb9O9VQ/sNwWnCtCyncap47LNg=="}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:18.019809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-da39210c-b5c8-4acf-8cc4-2bbb3d424acb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:18.037132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-da39210c-b5c8-4acf-8cc4-2bbb3d424acb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for user 4087b29e666c4afaa36118e82eb169d3 and project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:18.119886 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:25:18.120460 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:25:18.120704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:25:18.121113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:25:18.121538 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:25:18.174997 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:18.180078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:18.180078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:18.180078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:18.180078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:18.180534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:18.254172 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for project 0cc9fe2e0830451c823180afe60ec921. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:18.268954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for user 3d5f53509b2f42269cd26e77c79ad8be and project 0cc9fe2e0830451c823180afe60ec921. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:18.294939 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-da39210c-b5c8-4acf-8cc4-2bbb3d424acb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.753332 Aug 04 21:25:18.307832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:25:18.310760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 12/19] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Aug 4 21:25:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 770 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 21:25:18.325519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:25:18.624677 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ee467cd5-579a-43b8-ad86-fdbd606e15e8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.563340 Aug 04 21:25:18.633457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 8/20] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:25:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:25:18.661138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9d43f0ff-b7fc-427b-bd0c-933481722ef3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:18.662938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9d43f0ff-b7fc-427b-bd0c-933481722ef3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:18.906599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9d43f0ff-b7fc-427b-bd0c-933481722ef3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:18.958794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9d43f0ff-b7fc-427b-bd0c-933481722ef3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1221 microversion: 2.1 time: 0.324150 Aug 04 21:25:18.961458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 13/21] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:18 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:19.111248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c96dd9e9-29b6-45ad-9654-28712d19b8f4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: .version_select at 0x7f8e723b8670>, body: {"keypair": {"name": "tempest-keypair-1726496862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLi0ZxkjoDDpfL8wr2PbV2zytUTktHY+v6+Fv4YpkcooOPN11fGWYzPAcs5Kq5SBarBV6ddK3Tx/zfUSiYfm98Z9efhNSbi+uUnxlFrUw6hCH4x+J2dyi42imXFQ65CmaA=="}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:19.215104 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-c96dd9e9-29b6-45ad-9654-28712d19b8f4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:19.236509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-c96dd9e9-29b6-45ad-9654-28712d19b8f4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:19.301862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1848441785", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:19.394991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c96dd9e9-29b6-45ad-9654-28712d19b8f4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.402135 Aug 04 21:25:19.396727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 9/22] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:25:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:19.436155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] validate_networks() for [('31a74276-e1d0-48dd-b1d1-b4f0b9cf64fe', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:25:21.728015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-43b957fc-15e9-43ee-9a6b-10f0c24d811a tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Action: 'create', calling method: .version_select at 0x7f8e71b67160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-526497733", "metadata": {"Type": "work"}}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:22.587377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:25:22.600475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:25:22.600475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:25:22.600475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:25:22.600475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:25:22.647881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:22.650839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:22.651811 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:22.654741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:22.655873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:22.661366 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:22.747879 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for project 0cc9fe2e0830451c823180afe60ec921. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:22.763421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for user 3d5f53509b2f42269cd26e77c79ad8be and project 0cc9fe2e0830451c823180afe60ec921. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:22.830365 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:25:22.838867 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:25:23.057252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-43b957fc-15e9-43ee-9a6b-10f0c24d811a tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.809846 Aug 04 21:25:23.057897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 10/23] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Aug 4 21:25:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1812 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 04 21:25:23.073221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-48c2d950-a57d-4e78-9d3a-9a72a756c78b tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Calling method '.version_select at 0x7f8e71b67dc0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:23.224569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-48c2d950-a57d-4e78-9d3a-9a72a756c78b tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901" status: 200 len: 352 microversion: 2.1 time: 0.153527 Aug 04 21:25:23.230736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 11/24] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:23 2022] GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:23.274027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d6d149b6-1b57-41cd-8430-7a98c484e6da tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.977265 Aug 04 21:25:23.275013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 14/25] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:25:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:25:23.289941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b92f5d77-eded-41a7-b3d8-4bfe0dfcb70f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:23.290538 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b92f5d77-eded-41a7-b3d8-4bfe0dfcb70f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:23.715258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b92f5d77-eded-41a7-b3d8-4bfe0dfcb70f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:23.746135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b92f5d77-eded-41a7-b3d8-4bfe0dfcb70f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1222 microversion: 2.1 time: 0.460652 Aug 04 21:25:23.750173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 12/26] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:23 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1222 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:24.245284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f0dfaf7a-644d-4d9f-b206-54d3e00b34e9 tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Calling method '.version_select at 0x7f8e723051f0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:24.430720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f0dfaf7a-644d-4d9f-b206-54d3e00b34e9 tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901" status: 200 len: 353 microversion: 2.1 time: 0.196239 Aug 04 21:25:24.431970 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:24 2022] GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 => generated 353 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:24.447619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e631b5bc-3f9d-4d5e-9e71-85d92d5054f5 tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Calling method '.version_select at 0x7f8e72305940>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:24.574369 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e631b5bc-3f9d-4d5e-9e71-85d92d5054f5 tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901" status: 200 len: 353 microversion: 2.1 time: 0.128755 Aug 04 21:25:24.574369 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:24 2022] GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:24.587448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-67016840-ba48-43b1-9431-a59fe42fcf6a tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Calling method '.version_select at 0x7f8e722e1f70>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:24.777340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-69ff1c6b-1eb2-48e7-9537-9dfec44e7ac8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: .version_select at 0x7f8e723d13a0>, body: {"keypair": {"name": "tempest-keypair-1345471452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1gUxAayurDxbHk8Zs2y3BPaoLsjkIAOYALyl/ljGv5TWkUyFteM9mEC0b9eiRIiSQ+0ziIvEFfVzj3WOm9UINWwCdWtMJkc5tIzIcrBmsOCrGT8QSsAHpqF8uLVXnMyA=="}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:24.814759 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-69ff1c6b-1eb2-48e7-9537-9dfec44e7ac8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for project 00814c2455be4608b2984adcf6353df2. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:24.825708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-69ff1c6b-1eb2-48e7-9537-9dfec44e7ac8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for user 9b29c3f2c29d4e2aba552c144cff94f8 and project 00814c2455be4608b2984adcf6353df2. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:25.018485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-69ff1c6b-1eb2-48e7-9537-9dfec44e7ac8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.698920 Aug 04 21:25:25.020938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 13/29] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:25.040807 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-698a70ad-a506-45b5-a321-96bc71d2a677 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:25.050112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-698a70ad-a506-45b5-a321-96bc71d2a677 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:25.156089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-67016840-ba48-43b1-9431-a59fe42fcf6a tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901" status: 202 len: 0 microversion: 2.1 time: 0.570354 Aug 04 21:25:25.159509 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:25:24 2022] DELETE /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:25:25.171629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5f5b0e94-7d9b-4dda-aeac-5d085f2ec38c tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Calling method '.version_select at 0x7f8e72305700>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:25.346251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5f5b0e94-7d9b-4dda-aeac-5d085f2ec38c tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901" status: 200 len: 352 microversion: 2.1 time: 0.129765 Aug 04 21:25:25.346251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 18/31] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:25 2022] GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:25.348339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-698a70ad-a506-45b5-a321-96bc71d2a677 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:25.353016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-698a70ad-a506-45b5-a321-96bc71d2a677 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1222 microversion: 2.1 time: 0.321437 Aug 04 21:25:25.357864 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 14/32] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:25 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:26.311549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-072681a0-de1e-4c24-8717-a8b6c98d810f tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Calling method '.version_select at 0x7f8e72305d30>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:26.397036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:26.397688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:26.410816 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:26.411465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:26.412919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:26.414731 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:26.415446 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:26.416082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-072681a0-de1e-4c24-8717-a8b6c98d810f tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] HTTP exception thrown: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-072681a0-de1e-4c24-8717-a8b6c98d810f tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Request method failure captured: Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 HTTP/1.1 Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlB9UEj2oZn9ovfvCkDeaMRKBHQ0jn5PYU-4Nb_vFUN3blxbfxK7v1b8bwoAKUdruoQBLbsr3Y-L6BAZ7eN2xxG6aB2ApPKZzrq4QHr-LIl_llBMIzLxFbaPW0juSS-Ox6jlI4jF0MLbSwrP5q9pi0gXqrZ9sj888xoAat7QrX_Y5k Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: fc7041e739f54122a0331445e91e6dba Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesGetTestJSON-2111118830 Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:26.489498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc7041e739f54122a0331445e91e6dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fc7041e739f54122a0331445e91e6dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fc7041e739f54122a0331445e91e6dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fc7041e739f54122a0331445e91e6dba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesGetTestJSON-2111118830 Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: fc7041e739f54122a0331445e91e6dba Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesGetTestJSON-2111118830 Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesGetTestJSON-2111118830-project Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ecbd9ed2a4c64c1e9998189af9e574d0 Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesGetTestJSON-2111118830-project Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'a9adbaf6-5270-406e-ad93-9d42a1286901'} Aug 04 21:25:26.492027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. (HTTP 404) (Request-ID: req-708d14de-94dc-45cf-a6b5-b499eff96147) Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:26.493197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:26.494232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:25:26.495462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-072681a0-de1e-4c24-8717-a8b6c98d810f tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] Returning 404 to user: Volume a9adbaf6-5270-406e-ad93-9d42a1286901 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-072681a0-de1e-4c24-8717-a8b6c98d810f tempest-VolumesGetTestJSON-2111118830 tempest-VolumesGetTestJSON-2111118830-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901" status: 404 len: 109 microversion: 2.1 time: 0.157193 Aug 04 21:25:26.496575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 19/33] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:26 2022] GET /compute/v2.1/os-volumes/a9adbaf6-5270-406e-ad93-9d42a1286901 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:25:26.835014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:26.875164 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2c09b6fc-c430-450e-b0ca-5098a836d8ce tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1226 microversion: 2.1 time: 0.485343 Aug 04 21:25:26.881990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 15/34] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:26 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1226 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:27.906427 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:27.908607 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:27.941971 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:27.955775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:27.959671 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:27.961617 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:27.965914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:27.971518 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:28.701363 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:28.733762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9b79cc37-ab13-4d6a-bf88-bc3e3ad459f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1274 microversion: 2.1 time: 0.836950 Aug 04 21:25:28.737224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 20/35] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:27 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1274 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:28.944178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:29.690546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1583488940", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "networks": [{"uuid": "80e0c419-b461-4c1f-a45f-ab0c4ea2a900"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:29.765315 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:29.766523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:29.792482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:29.792986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:29.793436 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:29.794154 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:29.794606 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:29.795036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:29.820385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] validate_networks() for [('80e0c419-b461-4c1f-a45f-ab0c4ea2a900', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:25:30.063585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:30.082119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6bd90481-9cf2-430b-99f2-666c1d5d4159 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1292 microversion: 2.1 time: 0.317080 Aug 04 21:25:30.098748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 21/36] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:29 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1292 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:31.112315 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:31.113047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:31.138951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:31.150495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:31.152667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:31.158215 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:31.158705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:31.178417 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:31.505025 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:31.523406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4a4bd792-e500-48f1-9c65-6d0e8e99fe8d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1280 microversion: 2.1 time: 0.415493 Aug 04 21:25:31.526917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 22/37] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:31 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1280 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:31.561571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1627187535", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49e52138-105f-4d18-a85f-2cbb22c5c910"}], "security_groups": [{"name": "tempest-securitygroup--1574600449"}], "key_name": "tempest-keypair-650827798", "user_data": "}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:31.869064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] validate_networks() for [('49e52138-105f-4d18-a85f-2cbb22c5c910', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:25:32.724297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:32.811113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=12 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:33.162872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:25:33.162872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:25:33.163715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:25:33.164424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:25:33.165211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:25:33.210576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:33.211099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:33.215795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:33.217262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:33.236817 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:33.237350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:33.361076 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Getting quotas for project 33e98e2129fe47bd8f81e1185d6a33a8. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:33.380968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Getting quotas for user 966b1056487d435ca83b6a9b15b0ecea and project 33e98e2129fe47bd8f81e1185d6a33a8. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:33.441412 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:25:33.444640 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:25:33.963846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-88abbb17-e755-4799-9243-3915ec1b471e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.026924 Aug 04 21:25:33.989517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 16/38] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:25:34.027612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:25:34.030992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:25:34.030992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:25:34.030992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:25:34.030992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:25:34.031820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-560006959", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f302c59-fa86-42bc-8bff-0f7c4eefd06a"}], "security_groups": [{"name": "tempest-securitygroup--704180857"}], "key_name": "tempest-keypair-1726496862", "user_data": "}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:34.085851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:34.088249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:34.092771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:34.096352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:34.100704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:34.102767 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:34.211442 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:34.227157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for user 4087b29e666c4afaa36118e82eb169d3 and project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:34.267849 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:25:34.270353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:25:34.468272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d63a47e7-c4e6-4c2e-ad5b-e7bb34ced10c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.935671 Aug 04 21:25:34.488118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 23/39] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Aug 4 21:25:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2960 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 21:25:34.533130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:34.534188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:34.626079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:34.626079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:34.626079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:34.626079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:34.653396 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:34.653396 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:35.025781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] validate_networks() for [('8f302c59-fa86-42bc-8bff-0f7c4eefd06a', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:25:35.686019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:35.699088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-505e9dcb-9f69-4848-b88c-84ac170c1017 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 1.208588 Aug 04 21:25:35.700575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 24/40] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:34 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:36.054545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9430424-4bb5-460d-a72c-98c2299395d1", "tag": "c8cba2cc-841c-408c-b9e2-5ff3b32f7242"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:36.086111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:36.120420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:36.120420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:36.144798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Creating event network-changed:c8cba2cc-841c-408c-b9e2-5ff3b32f7242 for instance e9430424-4bb5-460d-a72c-98c2299395d1 on hv-cinder-85220 Aug 04 21:25:36.146247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 21:25:36.147132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-0661bd26-74a9-463a-9a3e-07d991382244 req-d028ac1a-3519-4f94-b2a1-02ff62806e8b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 21:25:36.150118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:36.152013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:36.156655 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:36.157261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:36.158529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:36.159197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:36.209665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.compute.rpcapi [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 21:25:36.214214 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 21:25:36.262529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2f8c4943-e1e3-45c4-bc0e-266b1b83a5e9 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559900 Aug 04 21:25:36.264072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 25/41] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:36.275597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-774f8069-b346-4f8f-8e15-5515ef7f1b53 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:36.276873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-774f8069-b346-4f8f-8e15-5515ef7f1b53 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:36.578587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:25:36.579510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:25:36.579751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:25:36.580317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:25:36.580743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:25:36.605605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:36.606754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:36.609116 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:36.611954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:36.613921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:36.616236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:36.662333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:36.669792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:36.686962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:25:36.690170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:25:36.860704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-774f8069-b346-4f8f-8e15-5515ef7f1b53 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:36.871288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-774f8069-b346-4f8f-8e15-5515ef7f1b53 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1215 microversion: 2.1 time: 0.604890 Aug 04 21:25:36.883574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 26/42] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:36 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1215 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:36.896363 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-73376df3-a155-4cb6-a37d-a3534147e8a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:36.897224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-73376df3-a155-4cb6-a37d-a3534147e8a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:37.078701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5bff44f2-b2c9-487e-be5f-3984f0bb519a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.086323 Aug 04 21:25:37.085615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 17/43] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:25:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:25:37.317898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f5c4c3fa-8126-4987-b842-b0aec135ddf0 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Action: 'create', calling method: .version_select at 0x7f8e71b973a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1302245861", "metadata": {"Type": "work"}}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f5c4c3fa-8126-4987-b842-b0aec135ddf0 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Request method failure captured: Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 122 Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlP64_KGba_ZZbECOFWhWpwdXaV1VaoJmA9G5DjVRJat11dZtMvmA0iegIEYSIrNMJb9oJcmsFGTNj8QD1YwDljv8zeady3fT5ia678WCAoWP3-BlrRRc28KHMKsJiyk1KhddL9VlQjyPDDKL3vTrWDZpfh1Jz9sv-sL8QnlH_R3xU Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:25:37.327767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: b7b767fcc40a4aa5b10aef447745a977 Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1302245861", "metadata": {"Type": "work"}}} Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: Aug 04 21:25:37.329769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1302245861', 'metadata': {'Type': 'work'}}}} Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:37.330676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:25:37.332648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:25:37.333829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 21:25:37.333829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.335545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f5c4c3fa-8126-4987-b842-b0aec135ddf0 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:37.356732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f5c4c3fa-8126-4987-b842-b0aec135ddf0 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.268400 Aug 04 21:25:37.368779 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 18/44] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Aug 4 21:25:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:25:37.386840 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:37.387856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:37.435815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:37.440178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:37.442103 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:37.443016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:37.446507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:37.447114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:37.520371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-73376df3-a155-4cb6-a37d-a3534147e8a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:37.532973 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-73376df3-a155-4cb6-a37d-a3534147e8a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:37.536345 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-73376df3-a155-4cb6-a37d-a3534147e8a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:37.541422 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-73376df3-a155-4cb6-a37d-a3534147e8a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1281 microversion: 2.20 time: 0.666438 Aug 04 21:25:37.543433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 27/45] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:36 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1281 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:37.562372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7deafae3-e6ff-43c1-bf96-c57bda96127e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:37.564299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7deafae3-e6ff-43c1-bf96-c57bda96127e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:37.805034 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7deafae3-e6ff-43c1-bf96-c57bda96127e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:37.816875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7deafae3-e6ff-43c1-bf96-c57bda96127e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1241 microversion: 2.1 time: 0.272127 Aug 04 21:25:37.818368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 28/46] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:37 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1241 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:37.824075 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1919108c-a82f-4622-b07c-898665f51d30 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Action: 'create', calling method: .version_select at 0x7f8e71250700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-763198237", "metadata": {"Type": "work"}}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1919108c-a82f-4622-b07c-898665f51d30 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Request method failure captured: Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 119 Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlP64_KGba_ZZbECOFWhWpwdXaV1VaoJmA9G5DjVRJat11dZtMvmA0iegIEYSIrNMJb9oJcmsFGTNj8QD1YwDljv8zeady3fT5ia678WCAoWP3-BlrRRc28KHMKsJiyk1KhddL9VlQjyPDDKL3vTrWDZpfh1Jz9sv-sL8QnlH_R3xU Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:37.829590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b7b767fcc40a4aa5b10aef447745a977 Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-763198237", "metadata": {"Type": "work"}}} Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:37.830989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-763198237', 'metadata': {'Type': 'work'}}}} Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi '0' Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:37.831906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:25:37.833284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:25:37.834463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 21:25:37.834463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.850336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1919108c-a82f-4622-b07c-898665f51d30 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:37.850336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1919108c-a82f-4622-b07c-898665f51d30 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020665 Aug 04 21:25:37.850336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 29/47] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Aug 4 21:25:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:25:37.860119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ea280b83-410a-453b-9e5a-b7e3e766488b tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Action: 'create', calling method: .version_select at 0x7f8e711de550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-62348335", "metadata": {"Type": "work"}}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ea280b83-410a-453b-9e5a-b7e3e766488b tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Request method failure captured: Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 117 Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlP64_KGba_ZZbECOFWhWpwdXaV1VaoJmA9G5DjVRJat11dZtMvmA0iegIEYSIrNMJb9oJcmsFGTNj8QD1YwDljv8zeady3fT5ia678WCAoWP3-BlrRRc28KHMKsJiyk1KhddL9VlQjyPDDKL3vTrWDZpfh1Jz9sv-sL8QnlH_R3xU Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:37.866011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b7b767fcc40a4aa5b10aef447745a977 Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-62348335", "metadata": {"Type": "work"}}} Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:37.867894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-62348335', 'metadata': {'Type': 'work'}}}} Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise error Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi '' Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:37.868783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 21:25:37.870126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 21:25:37.871530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 21:25:37.871530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:37.875400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ea280b83-410a-453b-9e5a-b7e3e766488b tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:37.878858 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ea280b83-410a-453b-9e5a-b7e3e766488b tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029586 Aug 04 21:25:37.891401 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 30/48] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Aug 4 21:25:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:25:37.895895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:37.896537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:37.913665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:37.915230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:37.915996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:37.917300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:37.918698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:37.919496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:38.025125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:38.038519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4d7585d0-2b04-481e-b16a-09d97a64e801 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1219 microversion: 2.1 time: 0.147650 Aug 04 21:25:38.039783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 31/49] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:37 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:38.045173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d19ff813-2f5b-424f-820d-a7f4b52505ca tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Calling method '.version_select at 0x7f8e711dec10>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:38.116332 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-d19ff813-2f5b-424f-820d-a7f4b52505ca tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] HTTP exception thrown: Volume tempest-invalid-1299436513 could not be found. Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d19ff813-2f5b-424f-820d-a7f4b52505ca tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Request method failure captured: Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1299436513 HTTP/1.1 Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlP64_KGba_ZZbECOFWhWpwdXaV1VaoJmA9G5DjVRJat11dZtMvmA0iegIEYSIrNMJb9oJcmsFGTNj8QD1YwDljv8zeady3fT5ia678WCAoWP3-BlrRRc28KHMKsJiyk1KhddL9VlQjyPDDKL3vTrWDZpfh1Jz9sv-sL8QnlH_R3xU Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:38.137324 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b7b767fcc40a4aa5b10aef447745a977 Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Volume tempest-invalid-1299436513 could not be found. Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'tempest-invalid-1299436513'} Aug 04 21:25:38.141235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1299436513 could not be found. (HTTP 404) (Request-ID: req-b6dd59dc-f467-4311-ab89-3e2961138758) Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:38.142054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:25:38.143021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1299436513 could not be found. Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:38.144190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1299436513 could not be found. Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1299436513 could not be found. Aug 04 21:25:38.145320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.159976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d19ff813-2f5b-424f-820d-a7f4b52505ca tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Returning 404 to user: Volume tempest-invalid-1299436513 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:38.171824 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d19ff813-2f5b-424f-820d-a7f4b52505ca tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1299436513" status: 404 len: 99 microversion: 2.1 time: 0.120476 Aug 04 21:25:38.177893 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 32/50] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Aug 4 21:25:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1299436513 => generated 99 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:25:38.216713 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-77ba664b-99a7-4d40-ab0b-c955650bb573 tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024872 Aug 04 21:25:38.220664 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 33/51] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Aug 4 21:25:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 21:25:38.247806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-bd555153-bcbe-4ec2-b8c9-e406ecbe340a tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019229 Aug 04 21:25:38.253702 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 34/52] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Aug 4 21:25:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 21:25:38.277243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7c0b62aa-6cd5-4121-9935-c3081a9c0e2f tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Calling method '.version_select at 0x7f8e712508b0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-7c0b62aa-6cd5-4121-9935-c3081a9c0e2f tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] HTTP exception thrown: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7c0b62aa-6cd5-4121-9935-c3081a9c0e2f tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Request method failure captured: Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/os-volumes/89d4b0b2-ddcd-43a7-ba55-86016e333a04 HTTP/1.1 Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlP64_KGba_ZZbECOFWhWpwdXaV1VaoJmA9G5DjVRJat11dZtMvmA0iegIEYSIrNMJb9oJcmsFGTNj8QD1YwDljv8zeady3fT5ia678WCAoWP3-BlrRRc28KHMKsJiyk1KhddL9VlQjyPDDKL3vTrWDZpfh1Jz9sv-sL8QnlH_R3xU Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:25:38.368924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b7b767fcc40a4aa5b10aef447745a977 Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '89d4b0b2-ddcd-43a7-ba55-86016e333a04'} Aug 04 21:25:38.370403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. (HTTP 404) (Request-ID: req-c0ac58e5-2c07-4b65-b92c-ae38b0b72e4f) Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:38.371266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 21:25:38.372361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 21:25:38.373470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7c0b62aa-6cd5-4121-9935-c3081a9c0e2f tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Returning 404 to user: Volume 89d4b0b2-ddcd-43a7-ba55-86016e333a04 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7c0b62aa-6cd5-4121-9935-c3081a9c0e2f tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/89d4b0b2-ddcd-43a7-ba55-86016e333a04" status: 404 len: 109 microversion: 2.1 time: 0.097505 Aug 04 21:25:38.374659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 35/53] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:25:38 2022] DELETE /compute/v2.1/os-volumes/89d4b0b2-ddcd-43a7-ba55-86016e333a04 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:25:38.375541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2086326190", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc67493d-9260-428c-aebc-c6f13345755b"}], "security_groups": [{"name": "tempest-securitygroup--1954876780"}], "key_name": "tempest-keypair-1345471452", "user_data": "}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:38.686905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] validate_networks() for [('bc67493d-9260-428c-aebc-c6f13345755b', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:25:38.883892 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:38.897197 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-aa980957-acae-4db9-bb3a-06f4af6aca40 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 1.527152 Aug 04 21:25:38.899700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 19/54] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:37 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:38.916786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06302488-974b-40e9-8af1-b0d876eb06aa tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Calling method '.version_select at 0x7f8e7123cc10>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:38.990501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-06302488-974b-40e9-8af1-b0d876eb06aa tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] HTTP exception thrown: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06302488-974b-40e9-8af1-b0d876eb06aa tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Request method failure captured: Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/os-volumes/7a9e7c2d-eefa-4482-8dd0-d79a5785560b HTTP/1.1 Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlP64_KGba_ZZbECOFWhWpwdXaV1VaoJmA9G5DjVRJat11dZtMvmA0iegIEYSIrNMJb9oJcmsFGTNj8QD1YwDljv8zeady3fT5ia678WCAoWP3-BlrRRc28KHMKsJiyk1KhddL9VlQjyPDDKL3vTrWDZpfh1Jz9sv-sL8QnlH_R3xU Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:25:39.003235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9509abcec8af4bba8056aa0e713a5370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 9509abcec8af4bba8056aa0e713a5370 Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-VolumesNegativeTest-1064329626 Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: b7b767fcc40a4aa5b10aef447745a977 Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-VolumesNegativeTest-1064329626-project Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '7a9e7c2d-eefa-4482-8dd0-d79a5785560b'} Aug 04 21:25:39.005271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. (HTTP 404) (Request-ID: req-23781d74-4cc6-4f32-8e3e-7b53058b380b) Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:39.006619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 21:25:39.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 21:25:39.009589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06302488-974b-40e9-8af1-b0d876eb06aa tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] Returning 404 to user: Volume 7a9e7c2d-eefa-4482-8dd0-d79a5785560b could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:25:39.011124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-06302488-974b-40e9-8af1-b0d876eb06aa tempest-VolumesNegativeTest-1064329626 tempest-VolumesNegativeTest-1064329626-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/7a9e7c2d-eefa-4482-8dd0-d79a5785560b" status: 404 len: 109 microversion: 2.1 time: 0.101432 Aug 04 21:25:39.020803 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 20/55] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:25:38 2022] GET /compute/v2.1/os-volumes/7a9e7c2d-eefa-4482-8dd0-d79a5785560b => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:25:39.038336 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:39.039534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:39.042667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=11 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:39.060681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:39.062349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:39.064326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:39.066167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:39.069397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:39.070535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:39.291426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:39.312290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:39.317278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:39.320213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b18bbbd5-3c18-40b9-8030-fe1b878c860f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1285 microversion: 2.20 time: 0.296155 Aug 04 21:25:39.322499 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 21/56] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:39 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:39.340568 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3d7ac76c-1b0c-475e-8687-68832247a22b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:39.341188 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3d7ac76c-1b0c-475e-8687-68832247a22b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:39.556583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3d7ac76c-1b0c-475e-8687-68832247a22b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:39.576878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3d7ac76c-1b0c-475e-8687-68832247a22b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1241 microversion: 2.1 time: 0.242672 Aug 04 21:25:39.576878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 22/57] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:39 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1241 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:39.582398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:39.585919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:39.598591 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:39.602887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:39.603722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:39.604787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:39.608674 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:39.609730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:39.802466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:25:39.802466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:25:39.802466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:25:39.802466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:25:39.802466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:25:39.803887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:39.803887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:39.803887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:39.803887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:39.804258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:39.804258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:39.814394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:39.825799 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6591d49d-b3b9-48bb-8f67-b0d774a36682 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1267 microversion: 2.1 time: 0.253401 Aug 04 21:25:39.827692 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 23/58] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:39 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:39.829624 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for project 00814c2455be4608b2984adcf6353df2. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:25:39.835305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for user 9b29c3f2c29d4e2aba552c144cff94f8 and project 00814c2455be4608b2984adcf6353df2. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:25:39.874769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:25:39.882729 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:25:39.974718 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b93cdf-c7eb-4067-8185-b6d326af5df1", "tag": "a82796a1-f3b1-4ad6-aba1-2ffd6d2e6320"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:40.009534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.017479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.020259 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.071790 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Creating event network-changed:a82796a1-f3b1-4ad6-aba1-2ffd6d2e6320 for instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 on hv-cinder-85220 Aug 04 21:25:40.072219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 21:25:40.072746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c3adc045-09c6-4f66-a464-fea6efc7138c req-4e7a7b17-21cd-426c-a2fa-2f639c484c2b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 21:25:40.073810 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.074429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.074903 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.075696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.076149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.076569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.089098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.compute.rpcapi [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 21:25:40.096975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] Releasing lock "compute-rpcapi-router" {{(pid=118550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 21:25:40.108289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8eb3f477-d031-4fd0-a39a-c7ed7662def8 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278849 Aug 04 21:25:40.110098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 24/59] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:40.118045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:40.119112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:40.127017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.127540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.127983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.128881 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.129330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.129745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.482424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b4a02ec6-13f2-440e-b44a-f67472298c88 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.046854 Aug 04 21:25:40.482424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 36/60] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:25:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:25:40.482424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:40.482424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:40.482424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.484708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.484708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.484708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.484708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.485058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.517824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:40.533275 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8c38018c-ac6d-4f38-aaeb-caae64ab9884 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.420708 Aug 04 21:25:40.546057 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 25/61] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:40 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:40.548507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d137a953-6ce4-45a9-b177-e9414a91e925 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:40.556605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d137a953-6ce4-45a9-b177-e9414a91e925 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:40.612892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:40.631059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:40.631895 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d137a953-6ce4-45a9-b177-e9414a91e925 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:40.636155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:40.638820 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-530e899b-bf56-4abf-a69d-c6902b42d5c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1333 microversion: 2.20 time: 0.229557 Aug 04 21:25:40.640811 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d137a953-6ce4-45a9-b177-e9414a91e925 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1238 microversion: 2.1 time: 0.101408 Aug 04 21:25:40.646701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 37/62] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:40 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1333 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:40.654288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f33f1005-a42a-4380-935a-491d0731f240 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:40.655143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f33f1005-a42a-4380-935a-491d0731f240 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:40.659434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 26/63] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:40 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:40.899941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:40.908219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:40.952643 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f33f1005-a42a-4380-935a-491d0731f240 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:40.953459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.953459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.953459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.953459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:40.953984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:40.953984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:40.954759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f33f1005-a42a-4380-935a-491d0731f240 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1241 microversion: 2.1 time: 0.311330 Aug 04 21:25:40.955445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 38/64] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:40 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1241 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:41.031425 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:41.043077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ab55adc3-d387-4ce1-983f-c635483d8de7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1267 microversion: 2.1 time: 0.161103 Aug 04 21:25:41.049592 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 27/65] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:40 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:41.554438 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:41.555052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:41.558329 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:41.561957 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:41.562471 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:41.563591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:41.564520 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:41.564974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:41.565400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:41.664145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-80c240f1-43b7-4913-8802-873b65d0ba42 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:41.665177 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-80c240f1-43b7-4913-8802-873b65d0ba42 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:41.744932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:41.758683 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-90145b6d-9e82-4dbc-bd1c-cc7f77362953 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.208607 Aug 04 21:25:41.759709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 39/66] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:41 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:41.764238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-80c240f1-43b7-4913-8802-873b65d0ba42 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:41.769039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:41.769039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:41.775933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-80c240f1-43b7-4913-8802-873b65d0ba42 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1238 microversion: 2.1 time: 0.115240 Aug 04 21:25:41.776784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 28/67] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:41 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:41.778205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:41.778913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:41.779649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:41.780642 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:41.781372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:41.781921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:41.886419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:41.896997 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:41.897287 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:41.898640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a8ff36a9-1d21-462f-8eb6-1284b1c432b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1333 microversion: 2.20 time: 0.137782 Aug 04 21:25:41.899206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 40/68] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:41 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1333 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:41.975408 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:41.976312 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:41.989136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:41.989136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:41.989136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:41.989136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:41.989485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:41.989485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.067830 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:42.076716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:42.079079 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-15f3db40-1cbc-4eb1-af00-c50372eed8f0 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1245 microversion: 2.1 time: 0.107672 Aug 04 21:25:42.079715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 29/69] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:41 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:42.084915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:42.111350 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.112609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.117170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.120655 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.121340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.121888 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.273935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:42.289056 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fc45a73e-aac1-487b-9f42-caa4c8fda9b9 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1267 microversion: 2.1 time: 0.221693 Aug 04 21:25:42.291587 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 41/70] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:42 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:42.780721 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:42.781449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:42.798251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:42.798897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:42.801272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.803029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.807772 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.810526 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.811018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.811485 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.812186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.812612 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.813000 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.813382 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.814469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.815811 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.925046 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:42.939767 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-43bbfec8-f97a-48dd-ab4f-f913d6254936 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1242 microversion: 2.1 time: 0.145542 Aug 04 21:25:42.942397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 42/71] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:42 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:42.962437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:42.963503 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:42.974057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.974862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.975649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:42.977322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:42.978090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:42.978786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:43.051369 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:43.059551 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-da6b5294-ff1b-45b3-8e6f-e4a8f1c4658d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.282932 Aug 04 21:25:43.060493 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 30/72] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:42 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:43.074973 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:43.089423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:43.090938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:43.092611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-efb2781f-04f1-4764-b4c2-7027017a5eb1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1333 microversion: 2.20 time: 0.148517 Aug 04 21:25:43.093768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 43/73] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:42 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:43.127729 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:43.128413 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:43.141942 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:43.142595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:43.143121 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:43.145508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:43.146012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:43.146451 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:43.255669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:43.264239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1124750a-6efd-4cb7-9538-21c6a6ad20a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1245 microversion: 2.1 time: 0.157515 Aug 04 21:25:43.276565 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 31/74] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:43 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:43.313073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:43.314160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:43.321021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:43.322011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:43.322572 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:43.323350 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:43.324175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:43.324414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:43.441647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:43.461269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f785b372-d098-4c2c-8fd2-894a57095a16 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1267 microversion: 2.1 time: 0.152741 Aug 04 21:25:43.471393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 44/75] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:43 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:43.975523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:43.976793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:43.986988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:43.987850 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:43.988440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:43.989698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:43.990435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:43.991118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.084302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:44.085299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:44.090994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.093325 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.094090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.094291 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.095956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.096607 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.097036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.099215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-034d5c34-4363-492e-a37f-8b5411825ae9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1242 microversion: 2.1 time: 0.130568 Aug 04 21:25:44.100011 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 32/76] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:43 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:44.117909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:44.118777 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:44.125671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.126667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.127077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.127980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.129082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.129504 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.216701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.226027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.227579 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.228712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-faea7455-212a-49ed-b82d-21ef56a673d4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1333 microversion: 2.20 time: 0.114863 Aug 04 21:25:44.229703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 33/77] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:44 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1333 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:25:44.289457 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.290613 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:44.291416 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:44.309262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3230ab67-62e2-4c27-b74f-9d645e08746f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.225471 Aug 04 21:25:44.309262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 45/78] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:44 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:44.309435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.309435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.309435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.309435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.309737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.309737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.405796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.413500 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a12636fd-285a-4107-a8fe-263b5b009612 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1245 microversion: 2.1 time: 0.128490 Aug 04 21:25:44.414073 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 34/79] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:44 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:44.501414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:44.505983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:44.521353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.521353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.521353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.521630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:44.522301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:44.536983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:44.653174 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:44.661396 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9971ed81-3286-4e8a-ae21-33aec9c2c168 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1267 microversion: 2.1 time: 0.172663 Aug 04 21:25:44.664028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 46/80] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:44 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:45.121616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:45.122829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:45.129340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.129992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.130228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.130926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.131387 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.131987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.202599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.212797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ea63f41c-d890-48fe-8690-8068be5dcc23 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1242 microversion: 2.1 time: 0.093955 Aug 04 21:25:45.212797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 35/81] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:45 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:45.261124 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:45.262166 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:45.272945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.273983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.274787 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.275998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.276632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.277546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.331096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:45.331837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:45.338434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.339503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.340135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.341009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.341467 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.341883 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.351688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.355617 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:45.362921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.365109 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.371461 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-06678b9b-aed3-4964-bdd7-82c1a09de4c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1341 microversion: 2.20 time: 0.112135 Aug 04 21:25:45.371461 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 47/82] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:45 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:45.434371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:45.435203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:45.442246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.443094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.443795 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.444698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.445513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.446138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.525735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.529305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.537735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3d491091-cb22-4f31-a8a5-b4b40cf77bd7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.210471 Aug 04 21:25:45.539173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 36/83] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:45 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:45.548828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c49144d8-38be-437b-a5d9-49af2dec07bc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1237 microversion: 2.1 time: 0.108463 Aug 04 21:25:45.549460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 48/84] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:45 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:45.693636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:45.694262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:45.702992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.703806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.705088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.711703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:45.712428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:45.715609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:45.777372 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:45.781039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:45.786681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fad5ac7e-0b81-4c07-a90a-ade26b388a82 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1275 microversion: 2.1 time: 0.102666 Aug 04 21:25:45.786896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 37/85] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:45 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:46.234301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:46.234920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:46.241386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.242770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.243563 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.244640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.245334 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.245910 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.359163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.373971 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e08b4c04-2fb3-4363-b235-c0175db41377 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1234 microversion: 2.1 time: 0.138100 Aug 04 21:25:46.382514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 49/86] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:46 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1234 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:46.389391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:46.389996 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:46.396827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.397290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.397724 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.398419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.398866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.399287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.462365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.470851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.472394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.473498 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-98d5b36f-cf25-45c6-a7de-7dd9cb3b1a7b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1351 microversion: 2.20 time: 0.088570 Aug 04 21:25:46.474046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 38/87] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:46 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:25:46.561082 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:46.561696 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:46.568822 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.569308 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.569738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.570436 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.570887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.571305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.574831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:46.575973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:46.587021 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.588194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.589566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.591090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.591663 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.592165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.709696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.738318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3a0efa5f-a677-4de6-90ae-b270e33f6933 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1293 microversion: 2.1 time: 0.167878 Aug 04 21:25:46.754131 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 39/88] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:46 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1293 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:46.801259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.808389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:46.809487 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:46.811464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-943a6315-7da3-4faf-9ad3-481f8b2a4e9f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.254387 Aug 04 21:25:46.824663 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.824973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.825328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 50/89] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:46 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:46.825909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.826653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:46.827104 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:46.827613 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:46.909069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:46.925095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-47efa7d9-6804-494d-b8f8-826e6c6fc615 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1285 microversion: 2.1 time: 0.118564 Aug 04 21:25:46.938162 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 40/90] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:46 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:47.393514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:47.395544 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:47.407825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.410990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.411647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.412960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.414821 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.416599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.499069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:47.499069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:47.510204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.510710 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.511133 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.511866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.512310 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.512908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.551475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:47.564353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1a5be33d-08b6-4c60-8c62-6d204523b8b8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1290 microversion: 2.1 time: 0.176408 Aug 04 21:25:47.576548 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 51/91] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:47 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1290 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:47.690559 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:47.701221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:47.702610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:47.708683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8b87ea57-6cfc-4058-bb8e-9d0d7ce9e97d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1339 microversion: 2.20 time: 0.216657 Aug 04 21:25:47.711383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 41/92] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:47 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:47.762873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:47.763551 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:47.773672 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.774327 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.775417 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.776494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.777735 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.785046 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.833899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:47.836938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:47.843724 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.844421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.845439 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.846287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:47.847469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:47.848041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:47.902219 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:47.910362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fccf57f4-b276-4b69-a6fd-ef498d790620 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1301 microversion: 2.1 time: 0.152209 Aug 04 21:25:47.910929 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 52/93] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:47 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1301 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:47.985073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:47.986055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:48.005741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:48.010810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:48.013584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:48.015360 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:48.016034 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:48.017628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:48.396417 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:48.407751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-249f4a91-765a-4169-9fec-35df9301f164 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.578442 Aug 04 21:25:48.422362 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 42/94] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:47 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:48.532652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:48.542536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3e6fe558-836f-415a-92fb-b3f04adf57a2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.569869 Aug 04 21:25:48.546512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 53/95] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:47 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:48.594145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:48.594857 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:48.614592 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:48.615518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:48.617800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:48.618699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:48.619273 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:48.622351 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:48.734289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:48.735186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:48.742827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:48.743346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:48.743779 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:48.744626 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:48.745250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:48.745832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:48.974616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:49.005224 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e537e679-1028-4965-8945-13e7d25418a3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1296 microversion: 2.1 time: 0.416545 Aug 04 21:25:49.006250 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 43/96] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:48 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1296 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:49.017693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:49.020090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:49.033478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:49.034306 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:49.039718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:49.041004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ab969dbb-5aa1-424b-b245-af5728dace37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.310707 Aug 04 21:25:49.043064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 54/97] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:48 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:49.045780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:49.049496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:49.050099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:49.050968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:49.051583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:49.054668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:49.395027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:49.405065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-947fd448-dc89-4ffb-b5ad-a9fa11afc795 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1299 microversion: 2.1 time: 0.396948 Aug 04 21:25:49.408777 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 44/98] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:49 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1299 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:49.430411 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:49.431285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:49.438279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:49.438769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:49.439274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:49.439961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:49.440467 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:49.440877 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:49.570405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:49.571662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:49.606884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:49.608579 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:49.610294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:49.618566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:49.619201 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:49.621530 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:49.821667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:49.833416 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=6 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:49.833416 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-05524225-c745-4b96-92c9-426ec01ded46 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.406007 Aug 04 21:25:49.846047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 55/99] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:49 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:50.027015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:50.027666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:50.039352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.040318 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.040771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:50.043429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.043920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.045019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:50.085733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:50.477251 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:50.520418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-470a409c-2b37-417f-a13e-b56ea11226ef tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.922442 Aug 04 21:25:50.520418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 45/100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:49 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:50.520418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:50.520418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:50.520418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.521421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.521421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:50.521421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.521421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.521773 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:50.856654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:50.870404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9872a920-f31a-404c-8757-0eab51bcbc63 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.847622 Aug 04 21:25:50.872024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 56/101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:50 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:50.880224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-7151bc83-10f1-43c0-863a-4175885bdf59 req-844c4dae-aa51-40f0-b4be-dfd2cf1d69b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6095465-0149-4b49-aa78-477c539cc1ab", "tag": "4cbbb647-9de6-4a48-bc4e-60ae51a218ac"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:50.897101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7151bc83-10f1-43c0-863a-4175885bdf59 req-844c4dae-aa51-40f0-b4be-dfd2cf1d69b9 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.898982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7151bc83-10f1-43c0-863a-4175885bdf59 req-844c4dae-aa51-40f0-b4be-dfd2cf1d69b9 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.898982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7151bc83-10f1-43c0-863a-4175885bdf59 req-844c4dae-aa51-40f0-b4be-dfd2cf1d69b9 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:50.919588 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-7151bc83-10f1-43c0-863a-4175885bdf59 req-844c4dae-aa51-40f0-b4be-dfd2cf1d69b9 service nova] Creating event network-changed:4cbbb647-9de6-4a48-bc4e-60ae51a218ac for instance e6095465-0149-4b49-aa78-477c539cc1ab on hv-cinder-85220 Aug 04 21:25:50.932041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-7151bc83-10f1-43c0-863a-4175885bdf59 req-844c4dae-aa51-40f0-b4be-dfd2cf1d69b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055667 Aug 04 21:25:50.934215 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 57/102] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:50.943933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:50.945015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:50.952810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=20 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:50.956343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.956343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.956343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:50.957234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:50.958270 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:50.959181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.041353 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:51.058109 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:51.062224 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:51.064516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-470250a1-243d-4723-8600-a7fe8d910949 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.575597 Aug 04 21:25:51.065670 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 46/103] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:50 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:51.170333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-7cfb6618-4b0f-490f-8fad-44aff0036ccb req-62320818-8f0b-435c-a6f4-88ffdabb9e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9430424-4bb5-460d-a72c-98c2299395d1", "name": "network-vif-plugged", "status": "completed", "tag": "c8cba2cc-841c-408c-b9e2-5ff3b32f7242"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:51.186837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-7cfb6618-4b0f-490f-8fad-44aff0036ccb req-62320818-8f0b-435c-a6f4-88ffdabb9e06 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.187737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-7cfb6618-4b0f-490f-8fad-44aff0036ccb req-62320818-8f0b-435c-a6f4-88ffdabb9e06 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.190094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-7cfb6618-4b0f-490f-8fad-44aff0036ccb req-62320818-8f0b-435c-a6f4-88ffdabb9e06 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.211103 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-7cfb6618-4b0f-490f-8fad-44aff0036ccb req-62320818-8f0b-435c-a6f4-88ffdabb9e06 service nova] Creating event network-vif-plugged:c8cba2cc-841c-408c-b9e2-5ff3b32f7242 for instance e9430424-4bb5-460d-a72c-98c2299395d1 on hv-cinder-85220 Aug 04 21:25:51.238896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-7cfb6618-4b0f-490f-8fad-44aff0036ccb req-62320818-8f0b-435c-a6f4-88ffdabb9e06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170377 Aug 04 21:25:51.240547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 47/104] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:51.248942 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:51.250299 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:51.261015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.261890 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.262788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.263966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.264647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.267657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.488222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:51.512210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-dc8685cc-c95c-424a-b4e1-4b784bde8ea1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.576053 Aug 04 21:25:51.514085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 58/105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:50 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:51.550143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:51.551137 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:51.560067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.560563 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.560995 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.561710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.562161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.562582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.770020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=36 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:51.927298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:51.934718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8c2d1983-67cb-472b-b46b-7dac32693657 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.389633 Aug 04 21:25:51.936024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 59/106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:51 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:51.943121 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:51.944067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:51.956704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.960523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.960523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.960523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:51.960523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:51.960908 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:51.993317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:52.005735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-524c59b7-9030-405e-a2b4-a763590195d5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.763779 Aug 04 21:25:52.006795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 48/107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:51 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:52.112749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:52.116787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:52.146163 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.148344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.151264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.154212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.156294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.159868 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.267688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:52.279527 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0db2d46f-5e4b-4c51-9fa7-00177bc0babb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.340025 Aug 04 21:25:52.294527 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 60/108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:51 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:52.444373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-aacba76e-0820-4789-bcf2-55857d81295c req-6a7bdabd-0d05-4b6e-a792-c1254a86e180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc8c40e-8238-4a1b-881e-1c681861109c", "tag": "76ca3f71-a844-42f8-95d3-2811dedb3915"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:52.457972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-aacba76e-0820-4789-bcf2-55857d81295c req-6a7bdabd-0d05-4b6e-a792-c1254a86e180 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.459060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-aacba76e-0820-4789-bcf2-55857d81295c req-6a7bdabd-0d05-4b6e-a792-c1254a86e180 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.459579 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-aacba76e-0820-4789-bcf2-55857d81295c req-6a7bdabd-0d05-4b6e-a792-c1254a86e180 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.473735 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-aacba76e-0820-4789-bcf2-55857d81295c req-6a7bdabd-0d05-4b6e-a792-c1254a86e180 service nova] Creating event network-changed:76ca3f71-a844-42f8-95d3-2811dedb3915 for instance ebc8c40e-8238-4a1b-881e-1c681861109c on hv-cinder-85220 Aug 04 21:25:52.480638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-aacba76e-0820-4789-bcf2-55857d81295c req-6a7bdabd-0d05-4b6e-a792-c1254a86e180 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041310 Aug 04 21:25:52.482270 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 61/109] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:25:52.536059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:52.536964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:52.537493 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:52.550047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.553184 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:52.553317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.553317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.553506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:52.553609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.553809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.554048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e1a09de4-27cd-4b00-a4c0-f575bb8d6829 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.448973 Aug 04 21:25:52.554604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.555591 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 49/110] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:52 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:52.752450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:52.760963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-622050dc-ba9d-4e23-93fd-ea7b131aab84 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.229977 Aug 04 21:25:52.761549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 62/111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:52 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:52.949069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}, {"name": "network-changed", "server_uuid": "cb24b55d-a68c-42ce-b470-6e1ed385c48a", "tag": "0c15de0d-bf72-4421-bc97-b7130c21786a"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:52.958668 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:52.959461 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:52.960235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.960702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.961122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.965426 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.971175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.971175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.971175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:52.971175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:52.971613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:52.974330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] Creating event network-changed:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:25:52.974831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] Creating event network-changed:0c15de0d-bf72-4421-bc97-b7130c21786a for instance cb24b55d-a68c-42ce-b470-6e1ed385c48a on hv-cinder-85220 Aug 04 21:25:52.981441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-c7804481-bf72-4278-ac84-5dc67bf57940 req-6aa7078c-12e5-46db-aa8d-2cf146073d1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036217 Aug 04 21:25:52.982039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 50/112] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:25:53.034503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:53.035425 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:53.054163 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.055162 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.055852 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.057460 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.057952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.058380 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.119974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.129463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b61b60cb-41f9-498a-b183-0efcb557bf15 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.175193 Aug 04 21:25:53.131492 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 63/113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:52 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:53.219868 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.231204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4af6eac8-149c-4ebc-9cc8-937b95d347a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.201133 Aug 04 21:25:53.232029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 51/114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:53 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:53.281849 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-6c9b05ca-4176-4c24-a61d-0905b979bd7c req-f8edfc6c-d149-432a-83b8-71aa940fe1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b93cdf-c7eb-4067-8185-b6d326af5df1", "name": "network-vif-plugged", "status": "completed", "tag": "a82796a1-f3b1-4ad6-aba1-2ffd6d2e6320"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:25:53.291278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-6c9b05ca-4176-4c24-a61d-0905b979bd7c req-f8edfc6c-d149-432a-83b8-71aa940fe1af service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.291855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-6c9b05ca-4176-4c24-a61d-0905b979bd7c req-f8edfc6c-d149-432a-83b8-71aa940fe1af service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.292348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-6c9b05ca-4176-4c24-a61d-0905b979bd7c req-f8edfc6c-d149-432a-83b8-71aa940fe1af service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.305141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-6c9b05ca-4176-4c24-a61d-0905b979bd7c req-f8edfc6c-d149-432a-83b8-71aa940fe1af service nova] Creating event network-vif-plugged:a82796a1-f3b1-4ad6-aba1-2ffd6d2e6320 for instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 on hv-cinder-85220 Aug 04 21:25:53.312075 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:53.313890 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-6c9b05ca-4176-4c24-a61d-0905b979bd7c req-f8edfc6c-d149-432a-83b8-71aa940fe1af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033943 Aug 04 21:25:53.314689 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:53.315204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 64/115] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:25:53.323015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.323579 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.324089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.324845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.325521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.325893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.527611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.540835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1f5fce02-8a4f-47d4-9494-57a305c7bc54 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.236099 Aug 04 21:25:53.542651 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 52/116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:53 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:53.580341 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:53.581028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:53.587260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.587844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.588210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.588897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.589343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.589773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.744494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.759150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.762271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.764522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e44b9fdd-e532-4dd4-a4ac-4edd20f21d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.188660 Aug 04 21:25:53.765205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 65/117] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:53 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:53.783845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:53.784455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:53.790940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.791665 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.796752 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.800933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:53.801636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:53.802497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:53.954991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:53.959834 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3f03221e-1ca4-406d-a20e-844917783ee4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.180970 Aug 04 21:25:53.960461 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 53/118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:53 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:54.150545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:54.152120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:54.158598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.159088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.159533 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.160221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.160664 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.161075 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.187746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:54.255245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:54.256556 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:54.264603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.268134 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.269164 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.270508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.271572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.273955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.336754 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:54.347016 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2f405ca7-deda-4dba-a32c-90f8a5224395 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.200763 Aug 04 21:25:54.355883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 66/119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:54 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:54.436820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:54.441745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2d441cff-1eae-4773-948d-a6bcde74effd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.190886 Aug 04 21:25:54.442928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 54/120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:54 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:54.574127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:54.574826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:54.591180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.591180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.591180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.591180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.591566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.591566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.733378 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:54.740966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f96633d1-d8f0-4e68-b5a4-0ea9627753ae tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.172375 Aug 04 21:25:54.741613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 67/121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:54 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:54.790073 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:54.790806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:54.798604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.807845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.807845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.807845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.807845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.808419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.953065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:54.959116 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:54.972733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:54.972733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:54.972733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-356c929a-32e4-48b6-a70d-636c00e54a33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.184089 Aug 04 21:25:54.973088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 55/122] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:54 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:54.982161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:54.982768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:54.989848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.990057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.990326 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:54.991022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:54.991675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:54.991965 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.129547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:55.138224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-06cf9ea9-6717-40c7-a2f9-fe34d2720212 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.159740 Aug 04 21:25:55.138734 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 68/123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:54 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:55.368433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:55.369105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:55.375279 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:55.375832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:55.376272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.377077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:55.377446 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:55.377786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.466907 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:55.468502 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:55.479229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:55.479229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:55.479229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.480141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:55.480347 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:55.480948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.566500 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:55.578308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-43af478e-2406-4e54-bc2a-e30338f52e2d tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.213664 Aug 04 21:25:55.591859 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 56/124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:55 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:55.746781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:55.757216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b5d2c8f2-2d72-46b7-87db-367acb4ea015 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.293058 Aug 04 21:25:55.758957 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 69/125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:55 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:55.772597 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:55.773454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:55.790684 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:55.790684 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:55.799206 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.800678 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:55.801699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:55.802370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:55.993149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:55.994063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:56.043803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:56.045227 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:56.046588 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:56.053732 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:56.055152 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:56.055698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:56.519957 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:56.538875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:56.538875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:56.538875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8b2e409e-3380-4cf4-8b8a-087b9359e4a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.546878 Aug 04 21:25:56.539172 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 70/126] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:55 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:56.553553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:56.554274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:56.561726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:56.562479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:56.564044 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:56.565825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:56.566553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:56.567202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:56.582443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:56.611659 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2d92d348-8798-4eda-b7ef-5ccb1ce512f8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.853069 Aug 04 21:25:56.612779 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 57/127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:55 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:56.617634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:56.620941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:56.643885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:56.644703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:56.645332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:56.646353 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:56.647094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:56.647859 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:56.973348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:56.987372 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e4602e34-1c09-4c6e-800e-a091b104a5d2 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.373274 Aug 04 21:25:56.988097 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 58/128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:56 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:56.993351 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:56.994208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:57.001163 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:57.002610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:57.003119 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:57.003929 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:57.004533 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:57.005019 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:57.155689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:57.165137 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:57.172326 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fa468c43-cf1b-4d4e-bc15-3c4244676a9f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.630885 Aug 04 21:25:57.173026 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 71/129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:56 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:57.173813 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-42391568-dcd9-4dc9-b853-d19749976d96 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.184305 Aug 04 21:25:57.174385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 59/130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:56 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:57.561921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:57.562718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:57.570592 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:57.571195 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:57.571832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:57.572818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:57.573389 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:57.573934 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:57.645240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:57.647048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:57.666297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:57.666297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:57.666297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:57.666297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:57.666699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:57.666699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:57.892675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:57.907675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:57.907675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:57.907675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-26360acc-49b9-473a-b28f-263426f48e15 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.348666 Aug 04 21:25:57.908121 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 72/131] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:57 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:25:57.935593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:57.952214 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b61b6974-8a16-4e7b-9ad2-7f8785a4f2fa tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.310252 Aug 04 21:25:57.952214 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 60/132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:57 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:58.027462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:58.027462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:58.032936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.033549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.034456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.035820 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.036351 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.036881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.195572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:58.196201 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:58.202727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.210014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.210014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.210014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.210014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.210511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.210905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:58.218550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-95a212eb-23b4-475d-9aa2-8c7f3e1c63cc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.200989 Aug 04 21:25:58.219355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 73/133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:58 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:58.225494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:58.227193 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:58.246460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.247383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.248031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.249087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.249872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.250571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.404017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:58.423897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-29f9dffc-d012-49b1-ab75-c127aa1ba1a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.220964 Aug 04 21:25:58.423897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 61/134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:58 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:25:58.440340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:58.451637 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c69fb90e-fdf5-4c52-a298-0f0335e9545a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.230563 Aug 04 21:25:58.462867 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 74/135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:58 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:58.939895 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:58.942630 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:58.964249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.964249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.964249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:58.965806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:58.966815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:58.977478 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:58.980686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:58.980993 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.000094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.001271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.002207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.003633 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.004804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.005758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.345586 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:59.363061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:59.363985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3db279eb-51da-438c-96c1-ce994398c869 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.392337 Aug 04 21:25:59.363985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 75/136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:58 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:59.367297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:59.367930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:59.374037 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.375016 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.375686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.376417 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.376870 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.377378 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.385173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:59.394297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:59.398253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9643c807-219d-494a-b256-943cb5194f80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.466764 Aug 04 21:25:59.401447 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 62/137] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:25:58 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:25:59.438884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:59.439673 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:59.456739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.457479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.460316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.461788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.462437 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.465917 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.554510 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:59.563826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f34c6c0f-9c1e-4ed7-a16c-62c1b06f7afb tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.199869 Aug 04 21:25:59.564403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 76/138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:59 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:25:59.569638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:25:59.570322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:25:59.577141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.579976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.579976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.579976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:25:59.579976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:25:59.580499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:25:59.679751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:25:59.696958 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e392d1a4-3601-4855-a515-56ce6ae428b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1322 microversion: 2.1 time: 0.261535 Aug 04 21:25:59.696958 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 63/139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:59 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:00.003659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.014715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0437c9d9-2ed4-4b18-843a-ab0acb205518 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.449093 Aug 04 21:26:00.015303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 77/140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:25:59 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:00.382797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:00.383496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:00.393376 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.393857 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.394287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.395014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.395505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.395927 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.427560 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:00.428659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:00.435164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.435673 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.436212 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.437195 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.437845 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.439245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.571629 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.584710 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5545c810-b0e0-4255-aa40-604b1173292a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.202548 Aug 04 21:26:00.584710 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 64/141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:00 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:00.588999 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:00.589637 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:00.601015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.601495 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.603790 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.604515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.604979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.605407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.607116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.616269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.617879 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.627783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1ce4eed3-f5aa-4d82-ae1a-fcbd3478fa10 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.197360 Aug 04 21:26:00.629085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 78/142] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:00 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:26:00.722022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:00.722992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:00.729648 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.730133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.730567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.731277 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.731748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.732168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.807140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.822429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-77766fce-3bd5-404f-9ccc-466d7f824a03 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.237318 Aug 04 21:26:00.823426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 65/143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:00 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:00.905133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:00.913638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6154dc0c-e670-4a43-a2b1-935d03c71334 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1516 microversion: 2.1 time: 0.195026 Aug 04 21:26:00.915371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 79/144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:00 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:00.938012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:00.942396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:00.950218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.953664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.953664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:00.953664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:00.953664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:00.954122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.037574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:01.038299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:01.039216 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lazy-loading 'flavor' on Instance uuid f4b93cdf-c7eb-4067-8185-b6d326af5df1 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:26:01.051296 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.051969 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.052550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.053633 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.067244 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.076914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.346771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:01.354429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2e2354a8-ef59-42ed-9cc6-47b04afa1a79 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.321732 Aug 04 21:26:01.355099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 80/145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:01 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:01.359964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-ad015da9-6af1-4f6d-9f82-df852d6540de req-fb841622-fcf8-4ffe-b229-8de58a8de5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6095465-0149-4b49-aa78-477c539cc1ab", "name": "network-vif-plugged", "status": "completed", "tag": "4cbbb647-9de6-4a48-bc4e-60ae51a218ac"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:01.370328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-ad015da9-6af1-4f6d-9f82-df852d6540de req-fb841622-fcf8-4ffe-b229-8de58a8de5de service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.370833 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-ad015da9-6af1-4f6d-9f82-df852d6540de req-fb841622-fcf8-4ffe-b229-8de58a8de5de service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.371239 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-ad015da9-6af1-4f6d-9f82-df852d6540de req-fb841622-fcf8-4ffe-b229-8de58a8de5de service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.384402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-ad015da9-6af1-4f6d-9f82-df852d6540de req-fb841622-fcf8-4ffe-b229-8de58a8de5de service nova] Creating event network-vif-plugged:4cbbb647-9de6-4a48-bc4e-60ae51a218ac for instance e6095465-0149-4b49-aa78-477c539cc1ab on hv-cinder-85220 Aug 04 21:26:01.389406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-ad015da9-6af1-4f6d-9f82-df852d6540de req-fb841622-fcf8-4ffe-b229-8de58a8de5de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032898 Aug 04 21:26:01.390011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 81/146] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:01.614143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:01.624882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:01.624972 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-641a0118-ed90-4ac8-b9a6-07b00c95294d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1/action" status: 200 len: 32 microversion: 2.1 time: 0.689021 Aug 04 21:26:01.624972 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 66/147] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:26:00 2022] POST /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1/action => generated 32 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:26:01.628578 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.629383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.629875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.630954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.631651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.632289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.635861 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:01.636697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:01.645048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.645932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.646729 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.647751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.648775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.649340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.820559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:01.831604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-14f91476-fd71-44bb-8c23-e693bbcd420a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.229228 Aug 04 21:26:01.832566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 82/148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:01 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:01.851857 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:01.855912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:01.862950 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:01.866502 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.867355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.867818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.868534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.868990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.869409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.881371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f4dcd659-051d-4d06-8fa0-20face8755f2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.251268 Aug 04 21:26:01.886002 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 67/149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:01 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:01.898605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:01.900209 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:01.913839 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:01.919372 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.920637 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.922267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:01.924770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:01.925244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:01.925677 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.155784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:02.166139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0fe0d2b0-b462-4b1d-b959-1a60ec873895 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.276977 Aug 04 21:26:02.171627 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 68/150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:01 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:02.240931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:02.258749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:02.268804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:02.268804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:02.268804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7e9fc146-5261-46e2-a314-ac1dbef812ce tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.433345 Aug 04 21:26:02.269468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 83/151] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:01 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:26:02.378292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:02.379181 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:02.388924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:02.388924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:02.388924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.388924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:02.389552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:02.389552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.570726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:02.588361 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-53406c67-cffa-4aa1-8476-cafc2cb702cd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.214459 Aug 04 21:26:02.588947 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 69/152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:02 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:02.853428 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:02.854348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:02.863157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:02.864003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:02.864971 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.866167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:02.866842 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:02.867517 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.906180 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:02.906925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:02.913714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:02.914453 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:02.914675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.915613 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:02.915848 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:02.916272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:02.949175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:03.160852 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.170240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e35d4606-bb91-400c-9858-d030f5eba56c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.267440 Aug 04 21:26:03.171039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 70/153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:02 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:03.189582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.192038 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:03.192662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:03.199346 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.199873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.200311 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.201018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.201471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.201896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.202107 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-da17df26-eb83-4dd3-8fc9-b962d5966cc0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.351821 Aug 04 21:26:03.202930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 84/154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:02 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:03.290893 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:03.292469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:03.303731 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.308698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.309371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.312943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.312943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.312943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.416922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.428531 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fd41fb72-549a-458e-9192-d7fda799354b tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.243203 Aug 04 21:26:03.429341 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 71/155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:03 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:03.434111 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-18d721db-2ef2-4408-8ab8-9b159a6450bf req-d1d94a97-0757-4fa3-8af4-9e0ae43d235d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb24b55d-a68c-42ce-b470-6e1ed385c48a", "name": "network-vif-plugged", "status": "completed", "tag": "0c15de0d-bf72-4421-bc97-b7130c21786a"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:03.444331 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-18d721db-2ef2-4408-8ab8-9b159a6450bf req-d1d94a97-0757-4fa3-8af4-9e0ae43d235d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.444853 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-18d721db-2ef2-4408-8ab8-9b159a6450bf req-d1d94a97-0757-4fa3-8af4-9e0ae43d235d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.445736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-18d721db-2ef2-4408-8ab8-9b159a6450bf req-d1d94a97-0757-4fa3-8af4-9e0ae43d235d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.457489 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-18d721db-2ef2-4408-8ab8-9b159a6450bf req-d1d94a97-0757-4fa3-8af4-9e0ae43d235d service nova] Creating event network-vif-plugged:0c15de0d-bf72-4421-bc97-b7130c21786a for instance cb24b55d-a68c-42ce-b470-6e1ed385c48a on hv-cinder-85220 Aug 04 21:26:03.463286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-18d721db-2ef2-4408-8ab8-9b159a6450bf req-d1d94a97-0757-4fa3-8af4-9e0ae43d235d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032470 Aug 04 21:26:03.463934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 72/156] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:03.536483 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.552511 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.555550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.557895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a945c212-96b4-4d69-a14d-3f3b45555785 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.271060 Aug 04 21:26:03.559091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 85/157] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:03 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:26:03.619024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:03.620515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:03.628877 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.629808 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.630219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.630928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:03.631734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:03.632523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:03.812171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:03.830760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-dacd65cb-e35a-4c3b-adbb-fc3189c579c7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.216879 Aug 04 21:26:03.842719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 73/158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:03 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:04.194604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:04.195258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:04.202520 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.203058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.204370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.205291 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.205759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.206181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.226976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:04.227733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:04.234209 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.234763 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.235270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.236116 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.236790 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.237428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.392338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:04.402015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f57886cd-7650-4dfd-8dc5-d039213a1b56 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.211106 Aug 04 21:26:04.402698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 86/159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:04 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:04.430851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:04.430851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3d332320-d688-4e1e-bdb7-6c8dc0a12a46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.206891 Aug 04 21:26:04.430851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 74/160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:04 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:04.450063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:04.450856 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:04.458455 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.459611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.460266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.461237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.462017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.462480 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.584602 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:04.586040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:04.596532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.597777 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.598599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.600744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.601385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.602095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.785752 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:04.795196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:04.798123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:04.799408 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e6a88ef7-eab2-4664-b0a7-2fb9bfbc98a7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.219837 Aug 04 21:26:04.800877 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 75/161] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:04 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:26:04.846387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:04.855990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:04.856936 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:04.858708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a43eb12f-e862-49f8-9b57-cc93a826065a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1315 microversion: 2.1 time: 0.412468 Aug 04 21:26:04.859760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 87/162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:04 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:04.864970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.865572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.866170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:04.867077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:04.867514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:04.867933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.034333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:05.042469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3dc0e6c3-e32b-4708-88da-1f4d20450fa5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.192500 Aug 04 21:26:05.043048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 76/163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:04 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:05.424818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:05.425935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:05.435067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.435794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.436886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.437777 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.438523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.438942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.452624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:05.454422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:05.465289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.466124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.466672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.467609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.468821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.470307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.612231 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:05.620505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3a9f3532-f08c-4b4c-ac03-d7aee37faa58 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.200510 Aug 04 21:26:05.625945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 88/164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:05 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:05.636149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-60793268-3d4a-4af0-b1e3-4ab858a09c7c req-5bfcf954-749b-4b5f-be67-dd53815b2b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc8c40e-8238-4a1b-881e-1c681861109c", "name": "network-vif-plugged", "status": "completed", "tag": "76ca3f71-a844-42f8-95d3-2811dedb3915"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:05.644697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:05.649333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:05.654115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ff38a6d7-2d6c-4676-954c-dff4e03ec870 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.207563 Aug 04 21:26:05.655374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 77/165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:05 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:05.658928 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-60793268-3d4a-4af0-b1e3-4ab858a09c7c req-5bfcf954-749b-4b5f-be67-dd53815b2b11 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.659558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-60793268-3d4a-4af0-b1e3-4ab858a09c7c req-5bfcf954-749b-4b5f-be67-dd53815b2b11 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.659991 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-60793268-3d4a-4af0-b1e3-4ab858a09c7c req-5bfcf954-749b-4b5f-be67-dd53815b2b11 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.675238 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-60793268-3d4a-4af0-b1e3-4ab858a09c7c req-5bfcf954-749b-4b5f-be67-dd53815b2b11 service nova] Creating event network-vif-plugged:76ca3f71-a844-42f8-95d3-2811dedb3915 for instance ebc8c40e-8238-4a1b-881e-1c681861109c on hv-cinder-85220 Aug 04 21:26:05.681434 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-60793268-3d4a-4af0-b1e3-4ab858a09c7c req-5bfcf954-749b-4b5f-be67-dd53815b2b11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051856 Aug 04 21:26:05.682108 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 89/166] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:05.825440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:05.826283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:05.833898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.834572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.835185 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.835960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.836404 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.836987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.884795 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:05.885706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:05.895063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.895569 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.896149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:05.897174 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:05.898944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:05.899824 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.021245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.032742 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.034578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.035928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-baa50b5b-6735-4038-a159-7db8239e50f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.214750 Aug 04 21:26:06.036486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 78/167] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:05 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:26:06.067782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:06.068665 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:06.076101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:06.077411 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:06.078000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.078903 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:06.079555 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:06.080039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.154864 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.164033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9b218890-8735-4b81-b113-702117019ed8 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1502 microversion: 2.1 time: 0.285834 Aug 04 21:26:06.171526 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 90/168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:05 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:06.242144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.250235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9ba418e5-8cba-4343-a086-8827abe04628 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1366 microversion: 2.1 time: 0.187258 Aug 04 21:26:06.263566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 79/169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:06 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:06.641745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:06.647199 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:06.655014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:06.655793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:06.656229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.657619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:06.658136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:06.658524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.677510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:06.678707 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:06.685386 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:06.685867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:06.691040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.691040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:06.691040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:06.691040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:06.850761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.859493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-61c8a8ea-bfd8-40c9-bd90-0e63663b1072 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.221419 Aug 04 21:26:06.868620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 91/170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:06 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:06.905484 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:06.913405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-36c37773-eac1-4a2c-9df6-d449bb37f9e0 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.240427 Aug 04 21:26:06.913977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 80/171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:06 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:07.068368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:07.069320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:07.078930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.090081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.090081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.090081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.090081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.090411 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.273067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:07.278523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:07.282598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:07.284292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.285464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.285894 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.287124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.287548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.288175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.292131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:07.293732 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:07.295027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-113c6567-644c-462a-a269-ef74760fab75 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.238264 Aug 04 21:26:07.296305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 92/172] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:07 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:26:07.476078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:07.491575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4a20672a-c693-49a2-b8c1-1b12cddbcb3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1556 microversion: 2.1 time: 0.223676 Aug 04 21:26:07.492553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 81/173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:07 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1556 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:07.513431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:07.514115 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:07.520447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.520927 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.521354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.522034 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.522478 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.523463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.652328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4dfaee93-264f-4c6b-a17e-93ca19384413 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143241 Aug 04 21:26:07.653556 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 93/174] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:26:07 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:07.696979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-ceaacb26-242d-4896-8278-451b3854d0bf req-aeac6f58-f735-4000-9e53-202c83a3820e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "name": "network-vif-plugged", "status": "completed", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:07.706985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-ceaacb26-242d-4896-8278-451b3854d0bf req-aeac6f58-f735-4000-9e53-202c83a3820e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.707481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-ceaacb26-242d-4896-8278-451b3854d0bf req-aeac6f58-f735-4000-9e53-202c83a3820e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.707899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-ceaacb26-242d-4896-8278-451b3854d0bf req-aeac6f58-f735-4000-9e53-202c83a3820e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.719276 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-ceaacb26-242d-4896-8278-451b3854d0bf req-aeac6f58-f735-4000-9e53-202c83a3820e service nova] Creating event network-vif-plugged:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:26:07.725121 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-ceaacb26-242d-4896-8278-451b3854d0bf req-aeac6f58-f735-4000-9e53-202c83a3820e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031957 Aug 04 21:26:07.728805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 82/175] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:07.893681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:07.894641 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:07.902170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.902739 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.903415 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.904309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.905013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.905445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.936071 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:07.937088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:07.960543 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.960543 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.960719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:07.962787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:07.965025 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:07.966317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:08.236049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:08.244863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7ec3c3e4-be85-4ba6-8fa1-82fc99215193 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1364 microversion: 2.1 time: 0.313632 Aug 04 21:26:08.245644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 83/176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:07 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:08.252216 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54c1de89-0aca-4863-8cef-963ce1ea0c7b"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:08.255679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:08.263455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:08.263954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:08.264371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:08.265293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:08.265743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:08.266756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:08.273015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:08.281353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-02a59fe8-6776-4d37-91dd-98a87fe97036 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.391986 Aug 04 21:26:08.282154 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 94/177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:07 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:08.321290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:08.322074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:08.341869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:08.342494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:08.342937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:08.343679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:08.344235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:08.345439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:08.723793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:08.733236 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:08.735562 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:08.736717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5387217e-3890-4625-a05b-775fd259b27b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.419505 Aug 04 21:26:08.737271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 95/178] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:08 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:26:09.272699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:09.273662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:09.289337 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:09.290072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:09.290596 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:09.292558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:09.293676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:09.294185 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:09.568922 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:09.581409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-397ab93a-efa9-4bae-b38a-fed0a2c58eb4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1551 microversion: 2.1 time: 0.317680 Aug 04 21:26:09.582261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 96/179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:09 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1551 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:09.602374 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:09.603540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:09.611647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:09.612152 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:09.612595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:09.613317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:09.613768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:09.614249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:09.926313 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e7d1cf16-884f-4d80-b5c0-bba78b8ccc48 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "POST /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.678649 Aug 04 21:26:09.928580 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 84/180] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:26:08 2022] POST /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab/os-volume_attachments => generated 194 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:09.941685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:09.943008 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:09.956805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:09.958123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:09.959219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:09.961092 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:09.962235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:09.963544 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:09.966711 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:09.982251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a4f2b7d2-4f62-4120-a51b-acf04831cd4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.395693 Aug 04 21:26:09.982941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 97/181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:09 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:09.990700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:09.992087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:10.001576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:10.002201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:10.003914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:10.004993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:10.005462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:10.005892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:10.108503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-449d6b2c-21bc-4f33-b0bd-cfc455c5b2f5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177201 Aug 04 21:26:10.109248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 85/182] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:26:09 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:10.129323 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-664fb39f-9f14-4020-973a-bab7974a562d req-fbb4fa9f-3ac4-4539-9e45-a6f57f9376aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb24b55d-a68c-42ce-b470-6e1ed385c48a", "tag": "0c15de0d-bf72-4421-bc97-b7130c21786a"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:10.141706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-664fb39f-9f14-4020-973a-bab7974a562d req-fbb4fa9f-3ac4-4539-9e45-a6f57f9376aa service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:10.142221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-664fb39f-9f14-4020-973a-bab7974a562d req-fbb4fa9f-3ac4-4539-9e45-a6f57f9376aa service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:10.143079 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-664fb39f-9f14-4020-973a-bab7974a562d req-fbb4fa9f-3ac4-4539-9e45-a6f57f9376aa service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:10.162974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-664fb39f-9f14-4020-973a-bab7974a562d req-fbb4fa9f-3ac4-4539-9e45-a6f57f9376aa service nova] Creating event network-changed:0c15de0d-bf72-4421-bc97-b7130c21786a for instance cb24b55d-a68c-42ce-b470-6e1ed385c48a on hv-cinder-85220 Aug 04 21:26:10.171473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-664fb39f-9f14-4020-973a-bab7974a562d req-fbb4fa9f-3ac4-4539-9e45-a6f57f9376aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060112 Aug 04 21:26:10.172429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 86/183] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:10.421695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:10.432936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:10.435156 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:10.437042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0c49a532-437f-4d83-8537-9948b38715a5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1407 microversion: 2.20 time: 0.452728 Aug 04 21:26:10.438839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 98/184] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:09 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:26:11.011260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:11.014842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:11.021619 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:11.022214 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:11.022853 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:11.023467 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:11.023954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:11.024420 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:11.340630 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:11.349636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cb9e4162-1db5-4b68-a5d2-fcc8231cb444 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.344482 Aug 04 21:26:11.359459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 87/185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:11 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:11.475793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:11.479989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:11.488038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:11.488862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:11.489292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:11.490175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:11.490632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:11.491058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:11.981444 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:11.996665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:11.999176 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:12.003144 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a3838936-9d18-48b1-adf7-e792935615b2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1600 microversion: 2.20 time: 0.534535 Aug 04 21:26:12.004981 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 99/186] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:26:11 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1600 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:26:12.042967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:12.043916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:12.056148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:12.057213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:12.058167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:12.059952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:12.061041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:12.062442 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:12.079340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:12.215213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ae6f7ee5-af19-4ff0-ae0e-73fcfd388ada tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.178891 Aug 04 21:26:12.216152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 88/187] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Aug 4 21:26:12 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:26:12.371368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:12.372233 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:12.378917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:12.382743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:12.382743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:12.382743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:12.382743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:12.383202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:12.674529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:12.684189 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f1c4ff5d-2c08-4aa2-87ec-2968173a2e42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.317108 Aug 04 21:26:12.695622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 100/188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:12 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:13.153101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-651cf033-eef8-48e1-aa72-4526d57f61e1 req-feac884e-8c3c-4bb9-a307-a1be613a216b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc8c40e-8238-4a1b-881e-1c681861109c", "tag": "76ca3f71-a844-42f8-95d3-2811dedb3915"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:13.178151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-651cf033-eef8-48e1-aa72-4526d57f61e1 req-feac884e-8c3c-4bb9-a307-a1be613a216b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:13.182049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-651cf033-eef8-48e1-aa72-4526d57f61e1 req-feac884e-8c3c-4bb9-a307-a1be613a216b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:13.187280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-651cf033-eef8-48e1-aa72-4526d57f61e1 req-feac884e-8c3c-4bb9-a307-a1be613a216b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:13.220176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-651cf033-eef8-48e1-aa72-4526d57f61e1 req-feac884e-8c3c-4bb9-a307-a1be613a216b service nova] Creating event network-changed:76ca3f71-a844-42f8-95d3-2811dedb3915 for instance ebc8c40e-8238-4a1b-881e-1c681861109c on hv-cinder-85220 Aug 04 21:26:13.238809 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-651cf033-eef8-48e1-aa72-4526d57f61e1 req-feac884e-8c3c-4bb9-a307-a1be613a216b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091289 Aug 04 21:26:13.245835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 89/189] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:13.711175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:13.711986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:13.733685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:13.736869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:13.737312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:13.738306 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:13.738606 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:13.744288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:13.796403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:13.993210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:14.003380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a7d66f19-b403-4e09-a536-59144eb9c597 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.299428 Aug 04 21:26:14.003968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 101/190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:13 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:14.915225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-414c1a35-b89e-4424-be83-9023a4a0c589 req-5e5048d9-b603-4b82-a8cb-b5ecc4b86ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:14.937036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-414c1a35-b89e-4424-be83-9023a4a0c589 req-5e5048d9-b603-4b82-a8cb-b5ecc4b86ee3 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:14.938246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-414c1a35-b89e-4424-be83-9023a4a0c589 req-5e5048d9-b603-4b82-a8cb-b5ecc4b86ee3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:14.939414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-414c1a35-b89e-4424-be83-9023a4a0c589 req-5e5048d9-b603-4b82-a8cb-b5ecc4b86ee3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:14.971961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-414c1a35-b89e-4424-be83-9023a4a0c589 req-5e5048d9-b603-4b82-a8cb-b5ecc4b86ee3 service nova] Creating event network-changed:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:26:14.982002 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-414c1a35-b89e-4424-be83-9023a4a0c589 req-5e5048d9-b603-4b82-a8cb-b5ecc4b86ee3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082397 Aug 04 21:26:14.990278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 90/191] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:15.040944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:15.042001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:15.063707 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:15.069027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:15.069878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:15.073959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:15.074844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:15.076312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:15.363493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:15.373015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-65c19b8e-7323-4df1-acc7-9aa4794de75b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.337781 Aug 04 21:26:15.384218 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 102/192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:15 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:16.398955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:16.399750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:16.407696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:16.408419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:16.408939 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:16.409815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:16.410323 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:16.410800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:16.585974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:16.594185 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0882f46a-a043-4f0c-997e-9cb76efcea28 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.201655 Aug 04 21:26:16.595168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 91/193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:16 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:17.627887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:17.628805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:17.636147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:17.644149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:17.644149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:17.644149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:17.644149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:17.644526 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:17.854452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:17.863111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3c8cdf9c-39ff-4932-ac07-0896a9db6eae tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.239254 Aug 04 21:26:17.863747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 103/194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:17 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:18.886147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:18.886759 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:18.893319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:18.893788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:18.894213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:18.894884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:18.895395 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:18.895854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:19.052108 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:19.062509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-286d524f-b59c-4e5f-9307-e9958576d3b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.180135 Aug 04 21:26:19.064180 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 92/195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:18 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:20.084561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:20.085605 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:20.093918 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:20.095032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:20.095521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:20.096219 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:20.096664 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:20.097265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:20.260753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:20.270024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-dccfea52-2af6-412b-954b-3a5f89fb42e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.188570 Aug 04 21:26:20.270240 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 104/196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:20 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:21.290577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:21.291138 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:21.302190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:21.302190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:21.302190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:21.302190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:21.302688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:21.302688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:21.673950 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:21.681838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-182925e4-19d4-4fd0-b42a-f1b5671c0aeb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.395238 Aug 04 21:26:21.682422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 93/197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:21 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:22.706160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:22.706160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:22.712679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:22.713433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:22.713861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:22.716638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:22.717136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:22.717572 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:22.925509 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:22.944016 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-85ecece4-71f8-4565-8599-64474050a7a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.243830 Aug 04 21:26:22.944956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 105/198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:22 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:23.966641 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:23.967334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:23.973853 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:23.974336 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:23.974774 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:23.975501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:23.975955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:23.976371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:24.132857 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:24.142185 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-123e0141-6853-469b-9a3d-fd8235e58d19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.180110 Aug 04 21:26:24.142770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 94/199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:23 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:25.163652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:25.164347 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:25.170639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:25.171121 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:25.171581 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:25.172274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:25.172875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:25.173295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:25.343232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:25.352257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-39d19ab3-5058-49d3-9f2a-d94cfafd8e76 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.192484 Aug 04 21:26:25.357876 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 106/200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:25 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:26.380245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:26.380824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:26.392282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:26.392948 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:26.393389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:26.394092 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:26.394546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:26.394967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:26.532220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:26.541000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d183b088-a723-45ea-8f34-87cf244f7ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.165340 Aug 04 21:26:26.541762 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 95/201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:26 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:27.572289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:27.572877 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:27.579178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:27.579705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:27.580139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:27.580860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:27.581313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:27.581734 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:27.752468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:27.761149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d4e68a97-9909-4dcc-b94e-8f46a9804984 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.202185 Aug 04 21:26:27.761720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 107/202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:27 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:28.784198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:28.787160 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:28.802931 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:28.803461 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:28.804084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:28.805604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:28.806422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:28.807000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:28.961852 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:28.970112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-61f45365-a317-4574-865e-7b8dc7aed188 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.191526 Aug 04 21:26:28.970686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 96/203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:28 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:29.991359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:29.991985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:29.998199 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:29.998715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:29.999190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:29.999913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:30.000367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:30.000891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:30.164285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:30.173557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5651a380-282b-4837-90be-f8a3102838cb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.185800 Aug 04 21:26:30.174224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 108/204] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:29 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:31.207918 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:31.208515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:31.215140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:31.215650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:31.216076 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:31.216760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:31.217203 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:31.217623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:31.372649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:31.380381 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9ccd4da6-da1f-4d64-b119-864bbf070d8f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.176376 Aug 04 21:26:31.380962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 97/205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:31 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:32.406312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:32.407164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:32.415512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:32.416339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:32.417119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:32.418069 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:32.419114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:32.419693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:32.608456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:32.616930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5beab719-b2d8-40ba-95ca-bdf42d8e1d9b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.215325 Aug 04 21:26:32.617531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 109/206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:32 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:33.638706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:33.639310 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:33.655059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=60 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:33.655059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:33.655059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:33.655059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:33.655492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:33.655492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:33.655492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:33.816189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:33.824758 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-13320511-8f6f-40d6-9a2e-8484ce90a2f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.190045 Aug 04 21:26:33.825322 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 98/207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:33 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:34.211026 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:34.211740 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:34.218046 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:34.218535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:34.219555 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:34.220301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:34.220709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:34.221192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:34.261870 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:26:34.804050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ea1282d3-7bc8-4ad6-8cdb-b7ad4832eba4 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 204 len: 0 microversion: 2.1 time: 0.585674 Aug 04 21:26:34.804050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 110/208] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:26:34 2022] DELETE /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:26:34.804204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:34.804204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:34.811389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:34.811878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:34.812390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:34.814131 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:34.814498 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:34.815343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:34.848614 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:34.879441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:34.879441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:34.879441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:34.879441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:34.879904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:34.879904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:34.879904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:34.994079 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:35.004972 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-58becc2e-4bb3-42a2-b046-0b05fe130aea tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1554 microversion: 2.1 time: 0.205855 Aug 04 21:26:35.016258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 99/209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:34 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:35.057019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:35.070827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-24390a29-e684-42c6-bf7b-af48b389b453 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.228457 Aug 04 21:26:35.071720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 111/210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:34 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:36.034465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:36.040146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:36.043523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:36.044241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:36.044428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:36.045118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:36.045557 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:36.045967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:36.095788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:36.097392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:36.103228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:36.103759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:36.104252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:36.104954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:36.105402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:36.105825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:36.205789 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:36.214483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fbde06cd-6016-455e-91e5-fd65f96fac21 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1554 microversion: 2.1 time: 0.184116 Aug 04 21:26:36.229349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 100/211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:36 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:36.258207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:36.271674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d3e7007f-da8a-4a6d-9b9b-753ec02513a5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.180995 Aug 04 21:26:36.272291 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 112/212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:36 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:37.240745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:37.241363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:37.257754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:37.258329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:37.258763 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:37.259563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:37.259998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:37.261152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:37.296728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:37.298619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:37.301841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:37.317043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:37.317692 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:37.318519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:37.319772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:37.320250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:37.320689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:37.549844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:37.558369 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-09660d13-db9d-408a-9fb8-0f3905218ed9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.268373 Aug 04 21:26:37.564432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 113/213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:37 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:37.575003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:37.588532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b021b555-59b6-41e6-97ca-59ddec58b3dc tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1554 microversion: 2.1 time: 0.354846 Aug 04 21:26:37.589239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 101/214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:37 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1554 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:38.329866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-8338a47c-09b0-42bc-ad13-8e08835eb7bb req-d75c3995-4285-42a2-89b5-e76a9ce0732a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6095465-0149-4b49-aa78-477c539cc1ab", "name": "network-vif-deleted", "tag": "4cbbb647-9de6-4a48-bc4e-60ae51a218ac"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:38.341565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8338a47c-09b0-42bc-ad13-8e08835eb7bb req-d75c3995-4285-42a2-89b5-e76a9ce0732a service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:38.342541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8338a47c-09b0-42bc-ad13-8e08835eb7bb req-d75c3995-4285-42a2-89b5-e76a9ce0732a service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:38.342973 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8338a47c-09b0-42bc-ad13-8e08835eb7bb req-d75c3995-4285-42a2-89b5-e76a9ce0732a service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:38.362166 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-8338a47c-09b0-42bc-ad13-8e08835eb7bb req-d75c3995-4285-42a2-89b5-e76a9ce0732a service nova] Creating event network-vif-deleted:4cbbb647-9de6-4a48-bc4e-60ae51a218ac for instance e6095465-0149-4b49-aa78-477c539cc1ab on hv-cinder-85220 Aug 04 21:26:38.369002 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-8338a47c-09b0-42bc-ad13-8e08835eb7bb req-d75c3995-4285-42a2-89b5-e76a9ce0732a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044633 Aug 04 21:26:38.373579 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 114/215] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:26:38.589802 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:38.590358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:38.601508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:38.602573 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:38.602934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:38.604204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:38.604958 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:38.605610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:38.616085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:38.616838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:38.624647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:38.625850 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:38.626420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:38.627109 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:38.627712 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:38.628050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:38.715892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:38.729789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e5bf3532-47d1-4276-9d10-7e7facbbf8e7 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1512 microversion: 2.1 time: 0.118032 Aug 04 21:26:38.730960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 115/216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:38 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1512 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:38.795657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:38.807378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-873e5aea-30df-466d-8e0f-bff11220b9d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.221714 Aug 04 21:26:38.808438 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 102/217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:38 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:39.756316 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:39.756848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:39.765021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:39.765498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:39.765937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:39.766625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:39.767073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:39.767515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:39.832548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:39.833796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:39.845896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:39.846579 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:39.847157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:39.848516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:39.849730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:39.850572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:39.892528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:39.905619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-882b4a30-3e62-4736-b718-4e3c06b6140e tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1512 microversion: 2.1 time: 0.153046 Aug 04 21:26:39.907058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 116/218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:39 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:40.015203 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:40.023942 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f58ede39-33a7-4c7d-a0d0-8dbfe58528e6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.196169 Aug 04 21:26:40.024532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 103/219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:39 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:40.940202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:40.940848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:40.947153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:40.948052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:40.948799 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:40.949928 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:40.950643 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:40.951416 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:40.966993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:41.015875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:41.023829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b70cadc9-c15f-429d-b461-8941dd1e070f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1346 microversion: 2.1 time: 0.088152 Aug 04 21:26:41.024597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 117/220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:40 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:41.045793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:41.046358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:41.053244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:41.053719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:41.054151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:41.054841 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:41.055291 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:41.055738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:41.195496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:41.203900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7c7fa0b3-faac-4691-84ef-63855a4150b9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.162090 Aug 04 21:26:41.204492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 104/221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:41 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:42.048039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:42.048638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:42.055148 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:42.055654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:42.056081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:42.056761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:42.057197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:42.057615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:42.096938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:42.097035 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:42.098749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:42.099453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lazy-loading 'fault' on Instance uuid e6095465-0149-4b49-aa78-477c539cc1ab {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:26:42.152250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966b1056487d435ca83b6a9b15b0ecea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e98e2129fe47bd8f81e1185d6a33a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:42.161117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5dae6114-e9f4-4852-a705-f1b642ae71d0 tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 200 len: 1351 microversion: 2.1 time: 0.116806 Aug 04 21:26:42.161696 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 118/222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:42 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:26:42.226357 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:42.227118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:42.234448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:42.234814 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:42.235249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:42.236470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:42.236932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:42.237453 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:42.394686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:42.402548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0e718ffb-47e3-4b2b-bb17-ef6717b9034c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.180393 Aug 04 21:26:42.403177 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 105/223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:42 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:43.185534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:43.185534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:43.190467 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:43.190956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:43.191407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:43.192122 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:43.192730 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:43.193177 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:43.210223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] HTTP exception thrown: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Request method failure captured: Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab HTTP/1.1 Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlIB4WovNyMSMpFWUN6LGpoyKoGacDV1oZGlTWsoI8rQLEAb78uN8gYORk7tYkjDplmMP128675CzPvv859JuXYM04zr73aZc36e_ykike0Z0CVDTi35g0Z_JBn9tP6l7Hz5_CIYRhK8l3PadoGJr9vyefrDqOGGdSKuo8-oYI-bCM Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:26:43.236704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 966b1056487d435ca83b6a9b15b0ecea Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.238192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'e6095465-0149-4b49-aa78-477c539cc1ab'} Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:26:43.239099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.240557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.241841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Returning 404 to user: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:26:43.241841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-70fac40c-33b5-4a78-a1db-cc3a29cad2ab tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 404 len: 111 microversion: 2.1 time: 0.061332 Aug 04 21:26:43.241841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 119/224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:43 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:26:43.366558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:43.368980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:43.375116 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:43.375629 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:43.376063 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:43.376743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:43.377187 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:43.377603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:43.391234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] HTTP exception thrown: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Request method failure captured: Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab/os-volume_attachments HTTP/1.1 Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlIB4WovNyMSMpFWUN6LGpoyKoGacDV1oZGlTWsoI8rQLEAb78uN8gYORk7tYkjDplmMP128675CzPvv859JuXYM04zr73aZc36e_ykike0Z0CVDTi35g0Z_JBn9tP6l7Hz5_CIYRhK8l3PadoGJr9vyefrDqOGGdSKuo8-oYI-bCM Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:26:43.395397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 966b1056487d435ca83b6a9b15b0ecea Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.396910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'server_id': 'e6095465-0149-4b49-aa78-477c539cc1ab'} Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:26:43.397879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:43.399430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:43.402212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Returning 404 to user: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:26:43.402212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-06c96a34-a461-4882-b2df-46f7465c593f tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034352 Aug 04 21:26:43.402212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 106/225] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:26:43 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:26:43.423846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:43.424445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:43.431487 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:43.432088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:43.432620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:43.433749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:43.434448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:43.434964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:43.573537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:43.581664 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2ecbaca7-1789-49e8-9f6d-729181ad3945 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.162502 Aug 04 21:26:43.582227 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 120/226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:43 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:44.605824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:44.606873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:44.620820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:44.621384 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:44.621731 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:44.622428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:44.622871 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:44.623289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:44.629033 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:44.769825 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:44.785303 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-81d3a20b-5046-4e23-ba68-b05518d59e19 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.184504 Aug 04 21:26:44.786050 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 107/227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:44 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:44.797437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:44.799079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:44.805747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:44.806240 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:44.806671 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:44.807393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:44.807848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:44.808266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:44.823669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] HTTP exception thrown: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Request method failure captured: Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab HTTP/1.1 Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlIB4WovNyMSMpFWUN6LGpoyKoGacDV1oZGlTWsoI8rQLEAb78uN8gYORk7tYkjDplmMP128675CzPvv859JuXYM04zr73aZc36e_ykike0Z0CVDTi35g0Z_JBn9tP6l7Hz5_CIYRhK8l3PadoGJr9vyefrDqOGGdSKuo8-oYI-bCM Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:26:44.834629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 966b1056487d435ca83b6a9b15b0ecea Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.835903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'e6095465-0149-4b49-aa78-477c539cc1ab'} Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:26:44.836657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.837701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.838750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Returning 404 to user: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:26:44.838750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6a306c7e-6314-43d4-bb52-90837411419a tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 404 len: 111 microversion: 2.1 time: 0.033183 Aug 04 21:26:44.838750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 121/228] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:26:44 2022] DELETE /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:26:44.840893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:44.841668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] [instance: e6095465-0149-4b49-aa78-477c539cc1ab] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:44.848583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:44.848987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:44.849444 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:44.850168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:44.850612 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:44.851027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:44.865061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] HTTP exception thrown: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Request method failure captured: Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab HTTP/1.1 Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlIB4WovNyMSMpFWUN6LGpoyKoGacDV1oZGlTWsoI8rQLEAb78uN8gYORk7tYkjDplmMP128675CzPvv859JuXYM04zr73aZc36e_ykike0Z0CVDTi35g0Z_JBn9tP6l7Hz5_CIYRhK8l3PadoGJr9vyefrDqOGGdSKuo8-oYI-bCM Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:26:44.867347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/33e98e2129fe47bd8f81e1185d6a33a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 33e98e2129fe47bd8f81e1185d6a33a8 Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-DeleteServersTestJSON-1172418371 Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 966b1056487d435ca83b6a9b15b0ecea Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-DeleteServersTestJSON-1172418371-project Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.874228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'e6095465-0149-4b49-aa78-477c539cc1ab'} Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:26:44.874901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. Aug 04 21:26:44.876031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:26:44.877077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] Returning 404 to user: Instance e6095465-0149-4b49-aa78-477c539cc1ab could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:26:44.877077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ab068b6b-9ef0-4add-bd93-ca87e712c4ee tempest-DeleteServersTestJSON-1172418371 tempest-DeleteServersTestJSON-1172418371-project] 10.222.0.25 "GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab" status: 404 len: 111 microversion: 2.1 time: 0.032604 Aug 04 21:26:44.877077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 108/229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:44 2022] GET /compute/v2.1/servers/e6095465-0149-4b49-aa78-477c539cc1ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:26:45.806800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:45.807435 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:45.814600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:45.816300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:45.816300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:45.816493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:45.816803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:45.817220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:45.975519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:45.987052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-21cab8f0-1855-4374-93e4-d744461b5755 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.182729 Aug 04 21:26:45.988054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 122/230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:45 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:47.012325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:47.013617 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:47.020350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:47.021038 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:47.021636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:47.022525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:47.023212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:47.023900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:47.200942 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:47.217746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-dbceba7d-c138-42dd-9dd2-3c8bc8e432fe tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.209083 Aug 04 21:26:47.234574 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 109/231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:47 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:48.242836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:48.244307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:48.250484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:48.250994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:48.251460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:48.252159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:48.252611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:48.253033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:48.486488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:48.493987 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-89c33db8-c664-4bb4-bcb6-ac601a2ae501 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.255101 Aug 04 21:26:48.494546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 123/232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:48 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:49.515039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:49.515672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:49.522796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:49.528664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:49.528664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:49.528664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:49.528664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:49.529173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:49.861497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:49.869257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d2a4b4fd-7496-4818-8aab-a5afbef74120 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1522 microversion: 2.1 time: 0.357964 Aug 04 21:26:49.869822 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 110/233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:49 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:50.898941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:50.898941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:50.900479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:50.901010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:50.901452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:50.902141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:50.902854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:50.903215 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:51.059743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:51.069335 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-18a18b22-70d6-46f9-bfe1-bb49ee0d8a6f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1502 microversion: 2.1 time: 0.180847 Aug 04 21:26:51.069917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 124/234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:50 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:51.099795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:51.101243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:51.112827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:51.113309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:51.113746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:51.114443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:51.114880 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:51.115298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:51.278398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:51.287564 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-26ea497e-2b2d-47bf-be45-47107edded6b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1516 microversion: 2.1 time: 0.200502 Aug 04 21:26:51.288130 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 111/235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:51 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:53.097403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:26:53.099583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:53.105433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:53.105915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:53.106345 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:53.107030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:53.107512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:53.107930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:53.130553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lazy-loading 'flavor' on Instance uuid e9430424-4bb5-460d-a72c-98c2299395d1 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:26:53.422647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2e690853-a5c7-41f0-8aba-3774f6059751 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/action" status: 200 len: 32 microversion: 2.1 time: 0.329689 Aug 04 21:26:53.424869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 125/236] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:26:53 2022] POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:26:53.435133 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:53.436012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:53.442886 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:53.443433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:53.443880 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:53.444639 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:53.445095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:53.447816 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:53.616028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:53.624784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-355c6861-8831-467b-a0b5-e7b5cb5ac847 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.194084 Aug 04 21:26:53.625482 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 112/237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:53 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:54.646829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:54.647549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:54.654480 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:54.654964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:54.655445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:54.656142 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:54.656595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:54.657018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:54.806851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:54.814628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-12b15cf1-f73f-4d5f-852f-f741e5bb8308 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.171852 Aug 04 21:26:54.815517 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 126/238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:54 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:55.834997 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:55.836230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:55.843153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:55.843735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:55.844158 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:55.844902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:55.845306 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:55.852292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:55.993724 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:56.001758 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-414d914a-9b42-4066-acaf-8013e88de7cf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.169978 Aug 04 21:26:56.002340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 113/239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:55 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:57.022927 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:57.023549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:57.029533 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:57.030006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:57.030515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:57.031200 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:57.031666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:57.032082 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:57.167051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:57.175030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-407bfed8-ba07-424d-b00f-4109c4a25f3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.156035 Aug 04 21:26:57.175659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 127/240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:57 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:58.196855 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:58.197382 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:58.203441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:58.203914 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:58.204405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:58.205139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:58.205507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:58.205921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:58.508256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:58.519230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0fdaac06-9284-41de-aaca-adc7786d5103 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.323392 Aug 04 21:26:58.519230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 114/241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:58 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:26:59.537338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:26:59.538034 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:26:59.544280 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:59.544802 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:59.545240 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:59.545935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:26:59.546386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:26:59.546810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:26:59.680387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:26:59.687969 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-200a035f-033f-4258-a885-88ee46390534 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.154608 Aug 04 21:26:59.688542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 128/242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:26:59 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:00.710667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:00.711272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:00.718366 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:00.718849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:00.719280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:00.723829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:00.723829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:00.723829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:00.865060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:00.872911 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-41da879d-5e02-4bc6-8c24-6777d5f3504c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.166616 Aug 04 21:27:00.873478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 115/243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:00 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:01.894130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:01.894733 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:01.900866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:01.901343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:01.901774 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:01.902452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:01.902897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:01.910083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:02.034367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:02.042440 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e3b0ec17-8a38-4faa-b597-349446747019 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.152180 Aug 04 21:27:02.043014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 129/244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:01 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:03.065305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:03.065895 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:03.072484 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:03.072977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:03.073426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:03.074114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:03.074559 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:03.074979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:03.240786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:03.263473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-96a5b756-eb87-4147-9bb0-cbe432aa67cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.189660 Aug 04 21:27:03.263473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 116/245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:03 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:04.277233 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:04.277836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:04.284774 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:04.285264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:04.285727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:04.286537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:04.286899 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:04.287344 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:04.443780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:04.450098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-827baeac-f8b7-47af-9b15-94248c38e307 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.176810 Aug 04 21:27:04.450668 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 130/246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:04 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:05.470627 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:05.471221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:05.473498 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=38 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:05.478302 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:05.478771 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:05.479198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:05.479902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:05.480349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:05.480762 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:05.621878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:05.630023 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-041da0c1-151e-4c83-9cce-42d3dd9da9b8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.163205 Aug 04 21:27:05.630680 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 117/247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:05 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:06.650417 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:06.651024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:06.662009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:06.662009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:06.662009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:06.662009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:06.662294 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:06.662294 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:06.813710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:06.822639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-30f4c5e6-3c3e-4553-b566-251002d61bdb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.176249 Aug 04 21:27:06.823416 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 131/248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:06 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:06.930920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:06.931518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:06.938362 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:06.938845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:06.940215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:06.941017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:06.941502 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:06.941921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:06.978750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6091e1c1-24fa-48d6-9af4-2416f89d8288 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/ips" status: 200 len: 150 microversion: 2.1 time: 0.050535 Aug 04 21:27:06.987215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 118/249] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:27:06 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/ips => generated 150 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:07.854928 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:07.855644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:07.864387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:07.864963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:07.865431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:07.866146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:07.866609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:07.867030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:08.036665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:08.043283 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:08.055666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a9405ee2-2320-4b94-a932-fc8afd4d90ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.205491 Aug 04 21:27:08.057761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 132/250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:07 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:08.096564 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:08.097126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:08.103575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:08.104208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:08.104642 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:08.105337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:08.105782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:08.106199 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:08.133284 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f878ee06-a1bf-4307-ab62-a53f9c37dc1f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/ips" status: 200 len: 146 microversion: 2.1 time: 0.040911 Aug 04 21:27:08.133912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 119/251] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:27:08 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:08.819753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad9eba71-edac-49b0-a32f-e788138bd520"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:08.822082 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:08.830403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:08.830928 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:08.831506 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:08.832211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:08.832656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:08.833068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:09.081423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:09.082026 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:09.088706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:09.089132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:09.089565 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:09.090258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:09.090702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:09.091126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:09.230982 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:09.239587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b1385603-f168-4c70-9061-57953a05debc tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.162855 Aug 04 21:27:09.240209 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 120/252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:09 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:09.501233 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:09.501876 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:09.509872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:09.509872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:09.509872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:09.510090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:09.510720 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:09.511139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:09.540397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f3ff762a-777e-43bc-ba74-23dcb7d1e495 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/ips" status: 200 len: 153 microversion: 2.20 time: 0.043319 Aug 04 21:27:09.542316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 121/253] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Aug 4 21:27:09 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:27:09.936120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a0fa8a75-8a28-4b9a-87bc-4a9170fcfd1b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.120419 Aug 04 21:27:09.940833 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 133/254] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:27:08 2022] POST /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:10.260677 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:10.261453 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:10.268305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:10.270780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:10.270780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:10.270780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:10.270780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:10.271147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:10.468034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:10.480392 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-12c520ca-74ef-4a6c-81ca-85eaca4086eb tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.223598 Aug 04 21:27:10.481499 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 122/255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:10 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:11.510261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:11.510946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:11.514568 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=44 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:11.524260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:11.524701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:11.525333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:11.526257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:11.526851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:11.527514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:11.705748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:11.714290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b13c2212-363c-4e1e-8c64-a32f7b6c660f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.208151 Aug 04 21:27:11.715077 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 134/256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:11 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:12.737471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:12.738189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:12.748358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:12.748358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:12.748358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:12.748358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:12.748792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:12.748792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:12.906820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:12.916693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6950163e-ae53-414c-9020-59432d9e8520 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.184219 Aug 04 21:27:12.917285 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 123/257] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:12 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:13.938240 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:13.938964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:13.946547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:13.950063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:13.950063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:13.950063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:13.950063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:13.950488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:14.091709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:14.099860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-37e02e96-b86b-4f6c-8add-8cd9c80152ed tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.165415 Aug 04 21:27:14.100397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 135/258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:13 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:14.183926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:14.184476 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:14.192332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:14.193173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:14.193818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:14.194545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:14.194990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:14.195432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:14.220404 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lazy-loading 'flavor' on Instance uuid 28509a51-71ec-4aab-a7c1-bfb56ed3a676 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:27:14.320705 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:14.931849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b041db15-43b8-42c3-9407-cd8aa1124b5a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/action" status: 202 len: 0 microversion: 2.20 time: 0.752020 Aug 04 21:27:14.932457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 124/259] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Aug 4 21:27:14 2022] POST /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:27:14.941509 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:14.942133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:14.948839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:14.949313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:14.949735 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:14.950493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:14.950932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:14.951369 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:15.107366 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:15.118630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:15.120470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:15.122194 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5db5a659-c595-40cc-9e24-2b9a513c8f23 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.184850 Aug 04 21:27:15.122308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c21ab5b-a9ba-46f9-b9a2-fdc1bc9c4b64"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:15.130892 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:15.135721 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 136/260] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:14 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:15.142348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:15.143089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:15.144080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:15.144293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:15.144839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:15.145225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:15.145909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:15.146433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:15.153004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:15.153004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:15.153004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:15.153750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:15.154365 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:15.155871 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:15.327582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:15.335808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-11002be0-33f5-4cdb-900a-302a46e8c9a2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.198921 Aug 04 21:27:15.336445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 137/261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:15 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:16.153011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:16.153011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:16.160901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cc0f3722-12f5-4440-9a41-2fc6f15604ee tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053462 Aug 04 21:27:16.163059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:16.163059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:16.163059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:16.163672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 125/262] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:27:15 2022] POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-volume_attachments => generated 194 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:27:16.163762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:16.164370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:16.165103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:16.359697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:16.360377 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:16.367111 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:16.367629 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:16.368061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:16.368744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:16.369185 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:16.369602 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:16.494090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:16.511960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:16.513799 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:16.515545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-74b79c1e-1d5a-4852-b06c-cd3a28edee59 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.368837 Aug 04 21:27:16.523259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 138/263] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:16 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:16.543117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:16.551648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ca18f3f0-2a18-4ca5-acca-3ef6912f4a1c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.196277 Aug 04 21:27:16.554170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 126/264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:16 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:17.539866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:17.540410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:17.547220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.547733 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.548167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.549373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.549821 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.550244 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.574138 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:17.574740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:17.581468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.581981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.582407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.583098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.583577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.583993 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.694388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:17.705320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:17.707660 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:17.709331 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-188bd8e8-4061-46cd-9ca8-6c866d5124ac tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.173203 Aug 04 21:27:17.710021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 139/265] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:17 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:17.756586 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:17.764903 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-64bc60b4-225c-490b-aaec-1c216c628a1d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1502 microversion: 2.1 time: 0.194711 Aug 04 21:27:17.765480 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 127/266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:17 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:17.785835 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0538cef6-a435-49d0-b771-2366a8c31d72"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:17.788256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:17.800126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.800126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.800126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.800126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.800913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.800913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.821998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] HTTP exception thrown: Cannot 'attach_volume' instance e9430424-4bb5-460d-a72c-98c2299395d1 while it is in vm_state rescued Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Request method failure captured: Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/os-volume_attachments HTTP/1.1 Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 74 Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk60dmJwv_DBHx-KVKMsfB6ewGKd9IIjuZmlw4lUiv3rZOeSMbMO7Eqdgejm3iM__A7OHbVi6-MlaNnC8DSqhoPyvYQP46rQ3zd_4srmtPoFstteE053HP8N4yYA9rEUApWIZizVzZbEILj6HgVo4Y_DPM6Gmez2NM21RNDWH73pOE Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:27:17.823749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 3d5f53509b2f42269cd26e77c79ad8be Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {"volumeAttachment": {"volumeId": "0538cef6-a435-49d0-b771-2366a8c31d72"}} Aug 04 21:27:17.825536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Cannot 'attach_volume' instance e9430424-4bb5-460d-a72c-98c2299395d1 while it is in vm_state rescued Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'server_id': 'e9430424-4bb5-460d-a72c-98c2299395d1', 'body': {'volumeAttachment': {'volumeId': '0538cef6-a435-49d0-b771-2366a8c31d72'}}} Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9430424-4bb5-460d-a72c-98c2299395d1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:27:17.827022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e9430424-4bb5-460d-a72c-98c2299395d1 while it is in vm_state rescued Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:27:17.828157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e9430424-4bb5-460d-a72c-98c2299395d1 while it is in vm_state rescued Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Returning 409 to user: Cannot 'attach_volume' instance e9430424-4bb5-460d-a72c-98c2299395d1 while it is in vm_state rescued {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-528bf463-aaff-44b0-ad39-2bcde5fc2fb4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043883 Aug 04 21:27:17.829274 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 140/267] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:27:17 2022] POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:27:17.838099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:17.838708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:17.845150 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.846350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.846778 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:17.847560 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:17.848008 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:17.848426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:18.127986 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cc1d8e7b-5cab-472f-bc72-2e7e0d4ef1b4 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/action" status: 202 len: 0 microversion: 2.1 time: 0.292671 Aug 04 21:27:18.127986 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 128/268] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:27:17 2022] POST /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:27:18.135636 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:18.136370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:18.142848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:18.143123 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:18.143559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:18.144257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:18.150453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:18.150453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:18.315899 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:18.323742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fc5c01b7-59ea-4747-9afc-1da3559f6a5f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1510 microversion: 2.1 time: 0.191951 Aug 04 21:27:18.326647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 141/269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:18 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:18.734646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:18.735339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:18.742298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:18.742945 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:18.743435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:18.744117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:18.744648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:18.745065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:18.888542 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:18.899396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:18.901283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:18.902778 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-abd8747d-5def-42ef-8387-b50e4c700a2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.172834 Aug 04 21:27:18.908649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 129/270] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:18 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:19.354285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:19.354880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:19.362304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:19.362847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:19.363483 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:19.364171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:19.366786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:19.366786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:19.554310 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:19.568155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-82dc2339-e64c-4aed-9b32-d0b05af664c0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1510 microversion: 2.1 time: 0.217395 Aug 04 21:27:19.569091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 142/271] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:19 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:19.926865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:19.927728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:19.936027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:19.936508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:19.936994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:19.937723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:19.938166 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:19.938577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:20.118470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:20.129847 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:20.131421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:20.135854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-24e67565-9dd5-4225-b7dc-0957966b1a73 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.210909 Aug 04 21:27:20.135854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 130/272] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:19 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:20.590782 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:20.591600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:20.603537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:20.606575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:20.606575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:20.606575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:20.606575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:20.606959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:20.756659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:20.764803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-94869884-2d7c-4bce-8f3f-960f31c6ca9a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1510 microversion: 2.1 time: 0.178940 Aug 04 21:27:20.767916 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 143/273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:20 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:20.818093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-365390d4-d2d0-4a5d-99c7-84682279abf6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: .version_select at 0x7f8e70f59430>, body: {"keypair": {"name": "tempest-keypair-523044164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc1kx527F3GgRBBl52glwYz0l7JkNma93QNlGDcWAQOnvNHZpUTG88wrjKt70D/gn6ZvXQDqADCnoxN4hLc1qhOLvT89Ajmr1AgdzJyhrehcKX/JmvgY6hTQMgdN982Kg=="}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:20.834374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-365390d4-d2d0-4a5d-99c7-84682279abf6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:27:20.839894 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-365390d4-d2d0-4a5d-99c7-84682279abf6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:27:20.944207 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-365390d4-d2d0-4a5d-99c7-84682279abf6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130090 Aug 04 21:27:20.945218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 131/274] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:27:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:21.158458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:21.162981 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:21.165583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:21.166204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:21.166675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:21.167494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:21.167951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:21.168381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:21.346172 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:21.354182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:21.355886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:21.357048 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6a97bbc3-fb2f-40c8-965d-6e31886144b1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.203308 Aug 04 21:27:21.357607 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 144/275] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:21 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:21.788440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:21.789377 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:21.798684 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:21.799165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:21.804388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:21.804388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:21.804388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:21.804388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:21.998492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:22.009952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ef4d7c27-8ac6-4e0e-b249-4ecd52533f53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1516 microversion: 2.1 time: 0.227057 Aug 04 21:27:22.010536 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 132/276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:21 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:22.381289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:22.382751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:22.405549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:22.406370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:22.406822 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:22.407588 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:22.408531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:22.412714 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:22.708359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:22.721207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:22.734317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:22.735801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-94c7cc28-a37c-4c06-be39-b13c1d06706a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.358543 Aug 04 21:27:22.736784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 145/277] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:22 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:23.621277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-950622752", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f302c59-fa86-42bc-8bff-0f7c4eefd06a"}], "security_groups": [{"name": "tempest-securitygroup--1256968728"}], "key_name": "tempest-keypair-523044164", "user_data": "}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:23.737336 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] validate_networks() for [('8f302c59-fa86-42bc-8bff-0f7c4eefd06a', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:27:23.760161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:23.760826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:23.767852 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:23.768330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:23.774649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:23.774649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:23.774649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:23.774649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:23.946066 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:23.954574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:23.958540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:23.959931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fca2e70e-a5a7-4412-9117-278cf88d82f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.204222 Aug 04 21:27:23.971860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 146/278] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:23 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:24.186707 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:27:24.187110 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:27:24.187841 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:27:24.188560 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:27:24.189208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:27:24.199528 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:24.200000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:24.200422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:24.201272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:24.201575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:24.201988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:24.226256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:27:24.231537 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:27:24.242566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:27:24.245028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:27:24.372717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-88907549-e2be-4c58-baf6-3d779fd05081 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.755755 Aug 04 21:27:24.373364 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 133/279] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:27:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:27:24.384572 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5a40b6f8-ed80-468b-9c96-142a94046ffb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:24.385173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5a40b6f8-ed80-468b-9c96-142a94046ffb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:24.441905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5a40b6f8-ed80-468b-9c96-142a94046ffb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:24.448932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5a40b6f8-ed80-468b-9c96-142a94046ffb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1240 microversion: 2.1 time: 0.068100 Aug 04 21:27:24.454223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 147/280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:24 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:24.903801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a25ba064-e5bc-4fb7-a174-511b5d343c83 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'create', calling method: .version_select at 0x7f8e71188310>, body: {"keypair": {"name": "tempest-keypair-1651473525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu0j3/gTIKLWooZJPeLehx8PTof/HhQgG3zKoPI/zDU4bJ0Pb05/lCmqs/tqn58Z1V788pStMopJZl86Gdjamgve1lCtK57XWJWrP4cwoE9lBKVkcMlweklcMWJXPXJ2Q=="}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:24.920069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-a25ba064-e5bc-4fb7-a174-511b5d343c83 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for project 0cc9fe2e0830451c823180afe60ec921. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:27:24.924508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-a25ba064-e5bc-4fb7-a174-511b5d343c83 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for user 3d5f53509b2f42269cd26e77c79ad8be and project 0cc9fe2e0830451c823180afe60ec921. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:27:24.983233 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:24.983993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:24.999388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:25.000109 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:25.001102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:25.002975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:25.003587 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:25.004156 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:25.034193 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a25ba064-e5bc-4fb7-a174-511b5d343c83 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135347 Aug 04 21:27:25.040362 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 134/281] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:27:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:25.151499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:25.161042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:25.162915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:25.164267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f02d28dc-e15b-488f-a715-9f9d5b782458 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.184915 Aug 04 21:27:25.164965 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 148/282] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:24 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:25.470669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:25.471270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:25.477577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:25.478044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:25.478469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:25.479357 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:25.480485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:25.488580 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:25.582483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:25.590124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fd35749f-0b74-4926-9ab1-6f8926a17e39 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1244 microversion: 2.1 time: 0.123783 Aug 04 21:27:25.590696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 135/283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:25 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:26.187779 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:26.188381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:26.195303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:26.195805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:26.196235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:26.196918 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:26.197362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:26.197782 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:26.217611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:26.339212 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:26.354623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:26.356545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:26.357849 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-78dd3d8f-2986-47b5-a902-060ea8bb2bc5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.174057 Aug 04 21:27:26.358602 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 149/284] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:26 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:26.610060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:26.610673 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:26.617440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:26.617921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:26.618356 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:26.619041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:26.619524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:26.619944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:26.695307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:26.703041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f3c7437a-7071-49f6-8287-3944323bd3b5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1244 microversion: 2.1 time: 0.096816 Aug 04 21:27:26.703711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 136/285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:26 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:27.382920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:27.383935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:27.396160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:27.397224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:27.401751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:27.403885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:27.404446 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:27.405409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:27.635710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:27.644133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:27.645550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:27.646698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-374570f5-8206-4ffa-bc40-3dd88ffaf541 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.268507 Aug 04 21:27:27.647448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 150/286] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:27 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:27.729121 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:27.739503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:27.746784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:27.747441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:27.747872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:27.748567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:27.749018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:27.749492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:27.813957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:27.831047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-36d237cf-6cab-444d-b23e-831e85ddf0be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1236 microversion: 2.1 time: 0.110170 Aug 04 21:27:27.832003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 137/287] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:27 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:27.964882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-823424480", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31a74276-e1d0-48dd-b1d1-b4f0b9cf64fe"}], "security_groups": [{"name": "tempest-securitygroup--1848135428"}], "key_name": "tempest-keypair-1651473525", "user_data": "}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:28.089168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] validate_networks() for [('31a74276-e1d0-48dd-b1d1-b4f0b9cf64fe', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:27:28.676559 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:28.677398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:28.688088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:28.688088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:28.688088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:28.688088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:28.688491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:28.688491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:28.846343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:27:28.847966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:27:28.848793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:27:28.849379 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:27:28.849988 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:27:28.874230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:28.874953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:28.875395 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:28.876415 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:28.877284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:28.877859 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:28.903501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for project 0cc9fe2e0830451c823180afe60ec921. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:27:28.909085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Getting quotas for user 3d5f53509b2f42269cd26e77c79ad8be and project 0cc9fe2e0830451c823180afe60ec921. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:27:28.930249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:27:28.932686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:27:28.964209 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:28.973474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:28.975588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:28.977646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e0031259-202c-4730-9e21-32b0f057ac5d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.307961 Aug 04 21:27:28.978620 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 138/288] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:28 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:28.992749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:28.992749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:28.997473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:28.998228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:28.999652 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:29.001737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:29.003657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:29.004222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:29.079959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f9375f3d-aaf1-43d9-91c2-cfaf9531b607 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.119357 Aug 04 21:27:29.086819 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 151/289] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:27:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:27:29.104198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:29.106100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f588da9b-e3da-49ef-988d-22137d0f325d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1298 microversion: 2.1 time: 0.126173 Aug 04 21:27:29.106698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 139/290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:28 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:29.115124 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-78fc9ab3-a005-4c83-9406-9bc641e69000 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:29.116979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-78fc9ab3-a005-4c83-9406-9bc641e69000 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:29.197687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-78fc9ab3-a005-4c83-9406-9bc641e69000 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:29.207676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-78fc9ab3-a005-4c83-9406-9bc641e69000 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1245 microversion: 2.1 time: 0.106182 Aug 04 21:27:29.211385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 152/291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:29 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:30.011549 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:30.013076 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:30.020560 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.021039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.021467 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.022153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.022595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.023009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.043488 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:30.129855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:30.131132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:30.139652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.140377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.140963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.141652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.142814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.143412 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.249016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:30.258535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:30.260309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:30.261488 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4d4f7d82-acf0-4700-bdd0-a252b49d75a4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.256721 Aug 04 21:27:30.262269 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 140/292] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:30 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:30.267537 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:30.268198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:30.274678 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.275174 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.275643 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.282153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.282153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.282153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.312663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:30.321042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-be41a14e-86d7-4843-8d0e-9da01098a67a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.194969 Aug 04 21:27:30.321610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 153/293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:30 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:30.345865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:30.352626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-04f9977d-5ac8-4698-909c-e47429425b8c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1249 microversion: 2.1 time: 0.089183 Aug 04 21:27:30.353192 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 141/294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:30 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:30.637084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1412792084", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "networks": [{"uuid": "adca7506-b553-4007-86bc-9e2332e869ba"}]}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:30.693004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] validate_networks() for [('adca7506-b553-4007-86bc-9e2332e869ba', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:27:30.776637 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-5531ec42-9e93-436a-941e-451fe87cabdf req-ad3d4e4c-c4b5-423c-8781-244f984f4e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11110c93-a770-4efa-baa5-8fa3eb3290b4", "tag": "5355b20d-dfe0-4e8f-a1a8-57247178bffa"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:30.794246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-5531ec42-9e93-436a-941e-451fe87cabdf req-ad3d4e4c-c4b5-423c-8781-244f984f4e66 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:30.795274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-5531ec42-9e93-436a-941e-451fe87cabdf req-ad3d4e4c-c4b5-423c-8781-244f984f4e66 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:30.796055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-5531ec42-9e93-436a-941e-451fe87cabdf req-ad3d4e4c-c4b5-423c-8781-244f984f4e66 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:30.808367 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-5531ec42-9e93-436a-941e-451fe87cabdf req-ad3d4e4c-c4b5-423c-8781-244f984f4e66 service nova] Creating event network-changed:5355b20d-dfe0-4e8f-a1a8-57247178bffa for instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 on hv-cinder-85220 Aug 04 21:27:30.813769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-5531ec42-9e93-436a-941e-451fe87cabdf req-ad3d4e4c-c4b5-423c-8781-244f984f4e66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043943 Aug 04 21:27:30.815366 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 142/295] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:31.102991 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:27:31.103434 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:27:31.103900 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:27:31.104307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:27:31.104762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:27:31.128030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.128630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.129125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.129936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.130492 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.130902 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.150003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Getting quotas for project e734c237455f4d42b1e34eeb6ed38511. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:27:31.154813 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Getting quotas for user 1039d83bfa58450ebe10e727f1dc0ea5 and project e734c237455f4d42b1e34eeb6ed38511. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:27:31.167078 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:27:31.169628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:27:31.288071 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:31.288792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:31.296017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.296739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.297263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.298040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.299381 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.299923 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.357702 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-92c388cd-69de-46fa-9f37-31ac52a1eb02 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725281 Aug 04 21:27:31.358805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 154/296] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:27:31.364381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:31.365194 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:31.372933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.373431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.378716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.378716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.378716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.378716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.480746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:31.507682 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:31.509989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:31.511803 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e555076b-2498-4a0c-b0f8-72ac856c4f0b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.229150 Aug 04 21:27:31.536027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 143/297] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:31 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:31.544309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7301fc09-1ded-4881-b2ff-1df7e4f63cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:31.545542 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7301fc09-1ded-4881-b2ff-1df7e4f63cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:31.588032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:31.598954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-13808d8f-2aa0-44aa-b66c-aeb4ddd46e8d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.238826 Aug 04 21:27:31.599570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 155/298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:31 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:31.612203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:31.613145 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:31.619933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.620424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.620856 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.621725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:31.622353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:31.622781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:31.678930 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7301fc09-1ded-4881-b2ff-1df7e4f63cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:31.686288 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7301fc09-1ded-4881-b2ff-1df7e4f63cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1214 microversion: 2.1 time: 0.148649 Aug 04 21:27:31.698727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 144/299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:31 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:31.725433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:31.733931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-81366e9f-e970-4387-a10c-95d1177c3d4e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1297 microversion: 2.1 time: 0.133122 Aug 04 21:27:31.734280 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 156/300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:31 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:32.547961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:32.548744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:32.556149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:32.556623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:32.557238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:32.562144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:32.562144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:32.562144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:32.629834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:32.630990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:32.637574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:32.638051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:32.638749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:32.639519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:32.640155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:32.640569 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:32.743610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:32.758044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:32.761517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:32.762979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-54d77869-7a56-48c8-a165-536a01c29aa7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.220678 Aug 04 21:27:32.764776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 145/301] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:32 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:32.771290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-777e6912-06bf-48da-8ad0-c7f65ffffad2 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:32.772266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-777e6912-06bf-48da-8ad0-c7f65ffffad2 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:32.870988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-777e6912-06bf-48da-8ad0-c7f65ffffad2 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:32.885280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-777e6912-06bf-48da-8ad0-c7f65ffffad2 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1214 microversion: 2.1 time: 0.113194 Aug 04 21:27:32.891344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 146/302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:32 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:32.897575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:32.898508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:32.900751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:32.914550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:32.920355 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:32.920355 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:32.920355 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:32.920355 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:32.920796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:32.980299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:32.999571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-02dd2db7-ea46-45bc-902c-74010acca06f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.374197 Aug 04 21:27:33.000157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 157/303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:32 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:33.112596 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:33.120448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-61f6462c-7854-472f-aa33-5cc71c9c819e tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.226990 Aug 04 21:27:33.120896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 147/304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:32 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:33.788014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:33.788686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:33.795206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:33.795762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:33.796187 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:33.796869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:33.797697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:33.798119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:33.910595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:33.911218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:33.918360 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:33.918843 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:33.919303 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:33.920017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:33.920466 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:33.920886 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:33.987390 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:33.992535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:33.994350 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:33.995691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ff6b16a6-91dd-4d6d-9cfd-4649f09b3825 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.212196 Aug 04 21:27:34.007735 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 158/305] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:33 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:34.022774 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:34.023846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:34.033320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:34.033994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:34.034600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:34.035540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:34.036602 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:34.037191 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:34.193246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:34.201179 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-058ec5ea-cfe9-4d83-bfc2-1d75a816b97f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.182400 Aug 04 21:27:34.201752 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 159/306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:34 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:34.206801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:34.207644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:34.210526 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:34.216672 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:34.217263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:34.217656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:34.218585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:34.219341 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:34.219953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:34.273360 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:34.284063 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0c9599ec-9d37-4805-84fb-c103e6f96326 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1218 microversion: 2.1 time: 0.378835 Aug 04 21:27:34.284984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 148/307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:33 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1218 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:34.461033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:34.469197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7288c6c2-485f-4271-a9cc-1ec4c25a2fe1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.266256 Aug 04 21:27:34.469810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 160/308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:34 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:34.676599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-3c7b274b-10ca-4d9e-962f-52bec606d98e req-c6e05969-cb4d-4c6b-811a-57406dbedd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf22c7f-6277-4d8e-b3f2-fae569fdcb65", "tag": "ed85d1f1-7378-435e-90bf-f89e3fc4e6dc"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:34.683232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3c7b274b-10ca-4d9e-962f-52bec606d98e req-c6e05969-cb4d-4c6b-811a-57406dbedd50 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:34.684856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3c7b274b-10ca-4d9e-962f-52bec606d98e req-c6e05969-cb4d-4c6b-811a-57406dbedd50 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:34.684856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3c7b274b-10ca-4d9e-962f-52bec606d98e req-c6e05969-cb4d-4c6b-811a-57406dbedd50 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:34.705491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-3c7b274b-10ca-4d9e-962f-52bec606d98e req-c6e05969-cb4d-4c6b-811a-57406dbedd50 service nova] Creating event network-changed:ed85d1f1-7378-435e-90bf-f89e3fc4e6dc for instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 on hv-cinder-85220 Aug 04 21:27:34.705491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-3c7b274b-10ca-4d9e-962f-52bec606d98e req-c6e05969-cb4d-4c6b-811a-57406dbedd50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039166 Aug 04 21:27:34.705491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 149/309] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:35.021987 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:35.022619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:35.029438 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.029919 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.030354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.031041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.031527 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.031949 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.231306 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:35.233546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:35.240887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.241426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.241860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.242640 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.243092 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.243675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.262937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:35.271967 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:35.273491 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:35.275028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-dc61a134-466b-43ce-8069-a9f36ddccc13 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.256915 Aug 04 21:27:35.275621 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 161/310] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:35 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:35.305003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:35.306239 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:35.311479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.312003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.312437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.313130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.313582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.314045 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.386449 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:35.395980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d4f24eec-a8c5-4be7-b536-e21c82b48e4f tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1266 microversion: 2.1 time: 0.094924 Aug 04 21:27:35.399980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 162/311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:35 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:35.402494 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:35.411167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-889909b9-61f2-4691-8299-422e2325e9a6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.187173 Aug 04 21:27:35.411882 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 150/312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:35 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:35.492418 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:35.499463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:35.501351 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.502096 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.502599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.503421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.504167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.504766 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.592248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-eb1b5233-a19b-4531-ab84-ed263013df84 req-8057160e-e88b-4c86-83a6-8d87f10cb412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11110c93-a770-4efa-baa5-8fa3eb3290b4", "name": "network-vif-plugged", "status": "completed", "tag": "5355b20d-dfe0-4e8f-a1a8-57247178bffa"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:35.603471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-eb1b5233-a19b-4531-ab84-ed263013df84 req-8057160e-e88b-4c86-83a6-8d87f10cb412 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.604337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-eb1b5233-a19b-4531-ab84-ed263013df84 req-8057160e-e88b-4c86-83a6-8d87f10cb412 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.604976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-eb1b5233-a19b-4531-ab84-ed263013df84 req-8057160e-e88b-4c86-83a6-8d87f10cb412 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:35.620256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-eb1b5233-a19b-4531-ab84-ed263013df84 req-8057160e-e88b-4c86-83a6-8d87f10cb412 service nova] Creating event network-vif-plugged:5355b20d-dfe0-4e8f-a1a8-57247178bffa for instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 on hv-cinder-85220 Aug 04 21:27:35.626547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-eb1b5233-a19b-4531-ab84-ed263013df84 req-8057160e-e88b-4c86-83a6-8d87f10cb412 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037744 Aug 04 21:27:35.627427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 151/313] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:27:35.742540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:35.753860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-16f3c034-9682-40b2-8172-84c2bd9933f5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.266587 Aug 04 21:27:35.754535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 163/314] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:35 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:35.949073 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2d3aa975-d0e8-44aa-bb8d-5be14267114a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:35.955760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d3aa975-d0e8-44aa-bb8d-5be14267114a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:35.956242 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d3aa975-d0e8-44aa-bb8d-5be14267114a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:35.957175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d3aa975-d0e8-44aa-bb8d-5be14267114a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.041190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2d3aa975-d0e8-44aa-bb8d-5be14267114a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Going to try to stop instance {{(pid=118550) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 21:27:36.260536 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2d3aa975-d0e8-44aa-bb8d-5be14267114a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action" status: 202 len: 0 microversion: 2.1 time: 0.315435 Aug 04 21:27:36.264135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 152/315] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:27:35 2022] POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:27:36.270097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:36.270780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:36.277313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.277889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.278387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.279136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.279701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.280185 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.300606 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:36.301611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:36.308016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.308584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.309095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.309956 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.310475 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.311072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.464289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.464289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8b4793c7-e5f6-491b-bb0b-7638536d95dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.182545 Aug 04 21:27:36.464289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 164/316] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:36 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:36.464289 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:36.464832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:36.464832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.464832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.464832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.465139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.465139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.465139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.491717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.505702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.507576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.509287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1ca1da08-0a98-48ef-a843-75cba38fafae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.214984 Aug 04 21:27:36.510825 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 153/317] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:36 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:36.527536 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:36.529512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:36.540077 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.540215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.540215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.540215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.540215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.540522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.540786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.545202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f4496f9f-87f2-4bf4-aa2c-1b6d8f3b66ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1272 microversion: 2.1 time: 0.095607 Aug 04 21:27:36.546044 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 165/318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:36 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:36.766469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.774105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:36.776663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:36.776786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-aa8b82b8-b0b8-4d4f-b437-fc5b3b010069 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.262618 Aug 04 21:27:36.776786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 154/319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:36 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:36.780609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.781085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.781515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.782193 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:36.783268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:36.783715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:36.914640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:36.927006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9b545ee7-0f76-49a1-a913-caf151ee6b48 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.156674 Aug 04 21:27:36.931627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 166/320] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:36 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:37.469241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:37.469890 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:37.476359 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.476833 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.477290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.477974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.478421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.478842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.543534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:37.544379 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:37.546654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:37.552257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.552818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.553249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.553944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.554527 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.554954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.630018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:37.639087 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-21c04bc3-70a3-45ca-a259-33ee23474c90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.173674 Aug 04 21:27:37.640318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 155/321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:37 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:37.646305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:37.647167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:37.653933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.654520 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.654953 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.655696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.656140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.656550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.937451 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:37.947326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-68aa8f53-f95f-4314-a679-6e71ec5f4cfc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.305614 Aug 04 21:27:37.947917 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 156/322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:37 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:37.952555 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:37.953430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:37.960281 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:37.961140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.962237 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.963300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.964866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.965585 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.966275 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.968841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:37.970375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:37.973557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-68eb72cd-4851-4f8e-a0d6-a97af663ba9a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.432139 Aug 04 21:27:37.973557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 167/323] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:37 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:37.977418 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:37.998972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:37.998972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.998972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:37.998972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:37.999561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:37.999561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:38.000153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:38.020371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:38.152968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:38.172970 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-85081776-c998-4f74-a91d-7ec52d8d410b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.198527 Aug 04 21:27:38.174029 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 168/324] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:37 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:38.255905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:38.268409 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-02d90c54-ba25-443d-8133-dd7816e40776 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1366 microversion: 2.1 time: 0.319145 Aug 04 21:27:38.278897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 157/325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:37 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:38.662986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:38.662986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:38.672792 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:38.673769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:38.676951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:38.676951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:38.676951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:38.676951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:38.713169 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-650d84ae-4267-4462-8693-af79f6b87f98 req-452ef0b5-a13a-4cd6-8a53-ad34f4d048e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a61b7fc-1e5c-4121-ab1b-288e52cb7e42", "tag": "f915a080-d83b-4b65-8199-c1422cd5ebef"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:38.729844 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-650d84ae-4267-4462-8693-af79f6b87f98 req-452ef0b5-a13a-4cd6-8a53-ad34f4d048e7 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:38.731029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-650d84ae-4267-4462-8693-af79f6b87f98 req-452ef0b5-a13a-4cd6-8a53-ad34f4d048e7 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:38.732326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-650d84ae-4267-4462-8693-af79f6b87f98 req-452ef0b5-a13a-4cd6-8a53-ad34f4d048e7 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:38.780058 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-650d84ae-4267-4462-8693-af79f6b87f98 req-452ef0b5-a13a-4cd6-8a53-ad34f4d048e7 service nova] Creating event network-changed:f915a080-d83b-4b65-8199-c1422cd5ebef for instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 on hv-cinder-85220 Aug 04 21:27:38.786440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-650d84ae-4267-4462-8693-af79f6b87f98 req-452ef0b5-a13a-4cd6-8a53-ad34f4d048e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078152 Aug 04 21:27:38.793535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 158/326] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:38.882441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:38.893125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-95a7a6a3-efac-422d-a6c8-05bdfdd11820 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.235461 Aug 04 21:27:38.904028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 169/327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:38 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:38.974863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:38.975702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:38.982658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:38.982949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:38.983248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:38.984013 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:38.984642 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:38.985073 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.005558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:39.011137 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:39.015116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.016003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.016622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.017340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.017791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.018352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.186648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:39.195303 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8d0d1d52-86ca-4ed4-a398-3c369cefe3d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.227906 Aug 04 21:27:39.196514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 159/328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:38 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:39.198580 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:39.203337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:39.207897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:39.211219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.211910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.212573 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.213541 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.214175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.214781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.217351 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:39.219147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:39.227465 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-39f87902-cd8d-4b66-a791-a9753cfa7185 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1746 microversion: 2.20 time: 0.222999 Aug 04 21:27:39.228139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 170/329] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:38 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1746 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:39.295223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:39.295894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:39.303689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.304343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.305029 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.305778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.306339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.306977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.367880 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:39.373288 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:39.378929 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f473af1a-6280-4845-954f-49acc30fc62c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.181118 Aug 04 21:27:39.380736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 160/330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:39 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:39.446255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:39.453788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ec636a71-b7e2-4cbd-b47c-d0020791da5c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1555 microversion: 2.1 time: 0.162624 Aug 04 21:27:39.454351 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 171/331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:39 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:39.474698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:39.475180 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:39.482700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.483180 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.483653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.484363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.484802 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.488577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.563998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cef50a68-2686-41fa-a62f-2e749aa4ec63 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093395 Aug 04 21:27:39.564600 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 161/332] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:27:39 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:39.916202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:39.916860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:39.923338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.923830 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.924294 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:39.929101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:39.929101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:39.929101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.067959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:40.079620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7ff772bb-776c-46df-8e30-ee378b561b69 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.167539 Aug 04 21:27:40.080303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 172/333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:39 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:40.245686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:40.245686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:40.254361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:40.255793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.256268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:40.256459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.257352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.259083 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.260237 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.261682 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.266141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.267441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.268442 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.272172 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.273226 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.274508 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.439754 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:40.450991 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:40.453861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:40.455272 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d49cb150-348d-45b8-b635-37c0dd556c97 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1746 microversion: 2.20 time: 0.207885 Aug 04 21:27:40.456181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 173/334] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:40 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:40.461784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:40.462392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:40.471076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.471855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.476853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.476853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.476853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.476853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.524118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:40.534005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-bb6d2af2-d6b7-43c8-8842-27761f7d0a4e tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.319581 Aug 04 21:27:40.534933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 162/335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:40 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:40.638766 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:40.647951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-eedd1d76-d1e8-4c52-8bf9-7260f41d585b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.190557 Aug 04 21:27:40.649452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 174/336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:40 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:40.812441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-d6f303f1-e9e1-4548-b332-cd393f7f9d52 req-41d7a7ed-0726-4c5b-b50f-e24c7aacc406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11110c93-a770-4efa-baa5-8fa3eb3290b4", "tag": "5355b20d-dfe0-4e8f-a1a8-57247178bffa"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:40.822661 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d6f303f1-e9e1-4548-b332-cd393f7f9d52 req-41d7a7ed-0726-4c5b-b50f-e24c7aacc406 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:40.823134 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d6f303f1-e9e1-4548-b332-cd393f7f9d52 req-41d7a7ed-0726-4c5b-b50f-e24c7aacc406 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:40.823589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d6f303f1-e9e1-4548-b332-cd393f7f9d52 req-41d7a7ed-0726-4c5b-b50f-e24c7aacc406 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:40.834521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-d6f303f1-e9e1-4548-b332-cd393f7f9d52 req-41d7a7ed-0726-4c5b-b50f-e24c7aacc406 service nova] Creating event network-changed:5355b20d-dfe0-4e8f-a1a8-57247178bffa for instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 on hv-cinder-85220 Aug 04 21:27:40.839736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-d6f303f1-e9e1-4548-b332-cd393f7f9d52 req-41d7a7ed-0726-4c5b-b50f-e24c7aacc406 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031192 Aug 04 21:27:40.840333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 163/337] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:41.102156 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:41.103150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:41.109508 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.109992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.110421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.111105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.111582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.112269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.143108 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=4 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:41.161377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=16 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:41.259679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:41.266335 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1fce191b-2d65-4027-a38a-f617cb1275c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.168978 Aug 04 21:27:41.266923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 175/338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:41 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:41.483776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:41.484575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:41.491259 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.491779 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.492218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.492943 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.493396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.493818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.555593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:41.556212 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:41.564087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.564623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.568728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.568728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.568728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.568728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.644227 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:41.654899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:41.656468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:41.657648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6ce37f4e-9bfd-43b4-bb34-e86bb284ea2c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1746 microversion: 2.20 time: 0.178681 Aug 04 21:27:41.658390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 164/339] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:41 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:41.672653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:41.673272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:41.679940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.680429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.680862 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.681566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:41.682217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:41.682640 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:41.733481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:41.742136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6f8369f4-d528-44b8-af96-b55222e8be1a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.190411 Aug 04 21:27:41.742629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 176/340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:41 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:41.836525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:41.845823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-26b3c738-42e6-4c8b-8aae-1d59f360f28d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.179568 Aug 04 21:27:41.846436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 165/341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:41 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:42.288925 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:42.289457 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:42.296447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.297015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.297525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.298338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.299048 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.299774 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.517520 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:42.526562 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-73feaa5e-2c31-41a5-8146-410356cf1e8b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.242239 Aug 04 21:27:42.528678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 177/342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:42 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:42.681685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:42.682347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:42.688797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.689557 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.690451 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.691371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.692760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.693422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.765410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:42.766057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:42.772881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.773747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.774267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.775166 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.775667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.778847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.875657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=18 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:42.964020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:42.974800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-92a0c640-aa94-47ed-8ea8-e038bfecde01 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.213924 Aug 04 21:27:42.975240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:42.980240 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 178/343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:42 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:42.984062 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:42.984858 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:42.994224 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:42.996930 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:42.997468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:42.998160 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-dc6bee9f-1781-4b5d-a221-e7bbad64b2bc tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1746 microversion: 2.20 time: 0.320661 Aug 04 21:27:42.998304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:42.998659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:42.999171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 166/344] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:42 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1746 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:43.008361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:43.009265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:43.009915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:43.180247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:43.187656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5c5c6d2c-227d-46bc-900e-a36501c16b87 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.210513 Aug 04 21:27:43.188216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 179/345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:42 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:43.553629 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:43.554561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:43.561023 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:43.561584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:43.562023 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:43.562722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:43.563184 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:43.563668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:43.702262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:43.710797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-68f9aa86-e8f3-44e0-b602-8a3864191f9d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.161773 Aug 04 21:27:43.711473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 167/346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:43 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:44.000387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:44.000995 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:44.007980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.008458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.009832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.009832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.010015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.010390 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.022801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:44.023512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:44.029867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.030350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.038712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.038712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.038712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.038712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.149412 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:44.157801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-161d97b7-c8b5-4c98-84c1-ce27803b90ff tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.161281 Aug 04 21:27:44.158414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 180/347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:43 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:44.179342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:44.180762 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:44.182267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:44.183443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-59ab35c0-5f5b-41ab-b594-5b8325f20114 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1746 microversion: 2.20 time: 0.165312 Aug 04 21:27:44.184349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 168/348] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:44 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:44.209041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:44.209758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:44.217385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.217955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.218595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.219295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.219781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.220195 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.367057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:44.374874 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-de4ab41a-1a5a-4e53-835d-f336027f5664 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.170238 Aug 04 21:27:44.375466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 181/349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:44 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:44.479153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-9680e6fe-f126-4af1-9094-ec25a0397c85 req-9549dcda-2c50-4b8c-ac58-2f5a585bfdcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "name": "network-vif-plugged", "status": "completed", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:44.489558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9680e6fe-f126-4af1-9094-ec25a0397c85 req-9549dcda-2c50-4b8c-ac58-2f5a585bfdcb service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.490030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9680e6fe-f126-4af1-9094-ec25a0397c85 req-9549dcda-2c50-4b8c-ac58-2f5a585bfdcb service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.490447 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9680e6fe-f126-4af1-9094-ec25a0397c85 req-9549dcda-2c50-4b8c-ac58-2f5a585bfdcb service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.501895 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-9680e6fe-f126-4af1-9094-ec25a0397c85 req-9549dcda-2c50-4b8c-ac58-2f5a585bfdcb service nova] Creating event network-vif-plugged:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:27:44.509373 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-9680e6fe-f126-4af1-9094-ec25a0397c85 req-9549dcda-2c50-4b8c-ac58-2f5a585bfdcb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034054 Aug 04 21:27:44.510208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 169/350] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:44.737534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:44.739034 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:44.745793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.746536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.746865 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.747709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:44.748378 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:44.748809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:44.902812 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:44.911089 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4fa5188c-669d-4ae3-b8c6-0ef5a3d3465a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.178382 Aug 04 21:27:44.911678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 182/351] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:44 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:45.179706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:45.180454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:45.186605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.187091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.187630 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.188270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.188723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.189222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.207924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:45.208621 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:45.215459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.216054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.216559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.217361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.217876 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.218584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.332792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:45.341686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-498a7a52-9b82-481a-8754-34f362843559 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.167194 Aug 04 21:27:45.342280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 170/352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:45 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:45.371497 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:45.381056 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:45.383288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:45.383832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a385f6f2-c5b9-4f2e-90b5-c084c5d1334a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1746 microversion: 2.20 time: 0.180403 Aug 04 21:27:45.384592 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 183/353] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:45 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:45.398144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:45.398753 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:45.405099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.405624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.406067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.406753 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.407201 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.407648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.547137 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:45.555985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-20d4d288-bf7b-4603-aca4-649db22fcf89 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.162642 Aug 04 21:27:45.556560 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 171/354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:45 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:45.934088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:45.934693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:45.942772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.943230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.943691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:45.944386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:45.944835 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:45.945253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.109364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:46.119094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a92e73de-eb9d-45d7-8111-4cce8f5666dd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.189026 Aug 04 21:27:46.122377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 184/355] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:45 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:46.365496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:46.366692 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:46.386719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.389814 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.390631 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.391794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.392465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.395421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.408784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:46.416023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:46.433739 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.434523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.435171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.436169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.436769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.437463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.538253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:46.634855 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:46.642776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0790f192-43b4-47da-9715-7dc1f7949947 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.282455 Aug 04 21:27:46.655824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 172/356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:46 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:46.660052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:46.661280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-1d8f9407-6181-44cb-928a-3cb27d16aa8f req-1acbaa88-66cb-4f70-9d00-49c490f2861f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf22c7f-6277-4d8e-b3f2-fae569fdcb65", "name": "network-vif-plugged", "status": "completed", "tag": "ed85d1f1-7378-435e-90bf-f89e3fc4e6dc"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:46.669770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:46.671956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:46.673029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-1d8f9407-6181-44cb-928a-3cb27d16aa8f req-1acbaa88-66cb-4f70-9d00-49c490f2861f service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.673535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a106940f-bd89-451d-aee1-6c40549daa24 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.268833 Aug 04 21:27:46.673849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-1d8f9407-6181-44cb-928a-3cb27d16aa8f req-1acbaa88-66cb-4f70-9d00-49c490f2861f service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.674427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-1d8f9407-6181-44cb-928a-3cb27d16aa8f req-1acbaa88-66cb-4f70-9d00-49c490f2861f service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.679344 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 185/357] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:46 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:46.680361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:46.681511 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:46.696956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.697727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.698346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.699224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:46.699859 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:46.700645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:46.701487 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-1d8f9407-6181-44cb-928a-3cb27d16aa8f req-1acbaa88-66cb-4f70-9d00-49c490f2861f service nova] Creating event network-vif-plugged:ed85d1f1-7378-435e-90bf-f89e3fc4e6dc for instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 on hv-cinder-85220 Aug 04 21:27:46.706787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-1d8f9407-6181-44cb-928a-3cb27d16aa8f req-1acbaa88-66cb-4f70-9d00-49c490f2861f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049613 Aug 04 21:27:46.707585 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 173/358] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:46.899689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:46.909508 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-825650ac-f2df-4ad0-a8bf-4f6f61b8b320 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.233495 Aug 04 21:27:46.910487 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 186/359] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:46 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:47.147626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:47.186292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:47.186292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:47.186292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:47.186292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:47.186706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:47.186706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:47.186706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:47.361751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:47.375618 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-11b586aa-2e86-4fb7-9341-cca61deaa644 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.231983 Aug 04 21:27:47.377431 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 174/360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:47 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:47.668043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:47.676429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:47.680817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:47.681547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:47.682208 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:47.682984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:47.683686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:47.684183 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:47.699221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:47.700098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:47.719652 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:47.720505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:47.721147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:47.722101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:47.722784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:47.723443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:47.935019 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:47.948458 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:47.950316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:47.952150 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8f8f35d4-7c26-4e75-84bc-9d9fe4ceec66 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.257331 Aug 04 21:27:47.962012 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:47.964588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 175/361] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:47 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:47.972646 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8b65fca3-ef59-4a20-8662-19827184899a tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.307595 Aug 04 21:27:47.973817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 187/362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:47 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:47.990124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:47.991114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:48.000952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:48.001732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:48.002392 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:48.003370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:48.004590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:48.005491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:48.241739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:48.260842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-720cf9db-ea73-47eb-a3ac-1d4c6aa965cd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.289170 Aug 04 21:27:48.262522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 176/363] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:47 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:48.398996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:48.399817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:48.407393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:48.408328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:48.409053 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:48.410061 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:48.410796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:48.411278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:48.685023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:48.696649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7f5326e5-7c0b-43d9-94ff-cb5ffc4d0c9e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.300964 Aug 04 21:27:48.696649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 188/364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:48 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:48.959249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-d5e4e087-4132-43ff-82d8-935846115b6f req-25c6eda2-6dbf-4f74-8e4e-010fecc86575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a61b7fc-1e5c-4121-ab1b-288e52cb7e42", "name": "network-vif-plugged", "status": "completed", "tag": "f915a080-d83b-4b65-8199-c1422cd5ebef"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:48.971756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d5e4e087-4132-43ff-82d8-935846115b6f req-25c6eda2-6dbf-4f74-8e4e-010fecc86575 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:48.973303 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d5e4e087-4132-43ff-82d8-935846115b6f req-25c6eda2-6dbf-4f74-8e4e-010fecc86575 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:48.973961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d5e4e087-4132-43ff-82d8-935846115b6f req-25c6eda2-6dbf-4f74-8e4e-010fecc86575 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:48.984596 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:48.987680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:48.991514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-d5e4e087-4132-43ff-82d8-935846115b6f req-25c6eda2-6dbf-4f74-8e4e-010fecc86575 service nova] Creating event network-vif-plugged:f915a080-d83b-4b65-8199-c1422cd5ebef for instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 on hv-cinder-85220 Aug 04 21:27:49.004360 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-d5e4e087-4132-43ff-82d8-935846115b6f req-25c6eda2-6dbf-4f74-8e4e-010fecc86575 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046930 Aug 04 21:27:49.004581 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.006993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.007428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 177/365] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:49.007817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.008560 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.011691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.011691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.024642 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:49.026923 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:49.038608 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.039266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.039903 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.041272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.041979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.042607 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.277073 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:49.286571 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a04b01db-df08-404d-bb88-6fcb65fa91cf tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.273034 Aug 04 21:27:49.287631 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 178/366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:49 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:49.292981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:49.293821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:49.301549 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.302303 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.302952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.304242 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.304953 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.305601 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.323461 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:49.333228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:49.335309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:49.336690 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-30487b6f-6d80-44ee-9163-952526bc7be8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.363233 Aug 04 21:27:49.337878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 189/367] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:48 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:49.526145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:49.540225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-752b693a-7857-43b5-a63f-e4241a20a23b tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1371 microversion: 2.1 time: 0.251248 Aug 04 21:27:49.541972 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 179/368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:49 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:49.719744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:49.722914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:49.733067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.733567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.736884 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.737628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:49.738812 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:49.739248 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:49.937765 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:49.950730 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2631a7dc-2c0f-4486-8e90-ebc2d33eba4a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.235472 Aug 04 21:27:49.951332 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 190/369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:49 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:50.326126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:50.326726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:50.333468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.333942 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.334369 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.335042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.335517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.335929 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.368127 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:50.368367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:50.368367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:50.369223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.369749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.370121 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.370810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.371419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.371846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.488943 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:50.496788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3fe0c91d-9a3f-4258-95f7-8c49e5990172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.174520 Aug 04 21:27:50.501952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 180/370] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:50 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:50.529677 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:50.538106 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:50.539687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:50.540857 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-80f6ffb6-9fa1-4113-b6e0-006e64b9d06a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.183351 Aug 04 21:27:50.541601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 191/371] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:50 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:50.569801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:50.570424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:50.576346 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.576820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.577254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.577938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.578386 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.578805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.710745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:50.717056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7ee25865-7a71-4224-898f-015adc70ab55 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1566 microversion: 2.1 time: 0.151375 Aug 04 21:27:50.717986 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 181/372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:50 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:50.739896 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:50.739896 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:50.765023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.765023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.765023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.765023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.765705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.765705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.870669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f574c5ea-ab86-40c3-b212-dfbd6103107d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135368 Aug 04 21:27:50.872055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 192/373] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:27:50 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:50.980345 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:50.980979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:50.987482 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.988017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.988473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:50.989161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:50.989605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:50.990018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:51.481051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:51.491153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a25730c6-6999-40c1-8239-5da5b73397d7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.522457 Aug 04 21:27:51.497305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 182/374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:50 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:51.520706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:51.522828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:51.534300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:51.535241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:51.539833 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:51.539833 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:51.540031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:51.540484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:51.569128 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:51.570576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:51.578465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:51.579594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:51.580455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:51.581518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:51.583428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:51.584131 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:51.780809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:51.804262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-237db49d-8f49-44d2-95e7-6db9cd5a1388 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1314 microversion: 2.1 time: 0.288502 Aug 04 21:27:51.808246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 193/375] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:51 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:51.895370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:51.907106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:51.908640 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:51.923909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2926dfbb-52d9-459e-95a9-87c11b64bd7e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.348747 Aug 04 21:27:51.923909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 183/376] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:51 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:27:52.529536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:52.529536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:52.530133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.530859 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.531488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:52.532377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.533225 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.533824 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:52.757804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-3c6f07ba-555c-43b6-83e8-620f5ed6b859 req-c6447fa4-2da9-48ec-b2c7-180e0cc33f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf22c7f-6277-4d8e-b3f2-fae569fdcb65", "tag": "ed85d1f1-7378-435e-90bf-f89e3fc4e6dc"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:52.772173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:52.786935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-034c1afc-9c80-42d6-9657-91d8b0f3f0c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.268689 Aug 04 21:27:52.789798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 194/377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:52 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:52.791644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3c6f07ba-555c-43b6-83e8-620f5ed6b859 req-c6447fa4-2da9-48ec-b2c7-180e0cc33f27 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.792450 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3c6f07ba-555c-43b6-83e8-620f5ed6b859 req-c6447fa4-2da9-48ec-b2c7-180e0cc33f27 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.793196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3c6f07ba-555c-43b6-83e8-620f5ed6b859 req-c6447fa4-2da9-48ec-b2c7-180e0cc33f27 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:52.812000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-3c6f07ba-555c-43b6-83e8-620f5ed6b859 req-c6447fa4-2da9-48ec-b2c7-180e0cc33f27 service nova] Creating event network-changed:ed85d1f1-7378-435e-90bf-f89e3fc4e6dc for instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 on hv-cinder-85220 Aug 04 21:27:52.820841 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-3c6f07ba-555c-43b6-83e8-620f5ed6b859 req-c6447fa4-2da9-48ec-b2c7-180e0cc33f27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065886 Aug 04 21:27:52.823016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 184/378] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:27:52.838926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:52.839567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:52.850402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.850993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.852205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:52.854023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.854488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.857317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:52.939995 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:52.942254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:52.950586 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.951668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.953918 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:52.958506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:52.960558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:52.961959 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:53.142340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:53.154653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9c23a892-5738-41af-a75a-6b837ffc3ed0 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1497 microversion: 2.1 time: 0.319680 Aug 04 21:27:53.155828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 195/379] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:52 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:53.342223 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:53.359361 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:53.362344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:53.367893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-512362f2-411c-4156-a71b-c775ec1c74e1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.433486 Aug 04 21:27:53.368488 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 185/380] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:52 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:53.811581 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:53.812264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:53.829712 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:53.830209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:53.830651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:53.831378 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:53.831837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:53.832298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:54.108531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:54.123069 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ba0bee1a-853e-4925-a16d-9a281c344f6d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.311803 Aug 04 21:27:54.123069 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 196/381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:53 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:54.404840 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:54.405995 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:54.417321 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:54.418085 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:54.420527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:54.421479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:54.422148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:54.422807 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:54.444025 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:54.444025 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:54.451995 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:54.454097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:54.454926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:54.458723 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:54.467017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:54.467017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:54.509331 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:27:54.689489 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:54.718652 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:54.724106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:54.726262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4a288f44-bdc0-4df5-85f5-a5a3dfaa6909 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.333391 Aug 04 21:27:54.730774 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 186/382] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:54 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:55.145099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:55.145684 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:55.151754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:55.152898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:55.153041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:55.153628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:55.154077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:55.154492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:55.210305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5f55b289-bfe5-4c9d-bc35-dcfa427b50f1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 204 len: 0 microversion: 2.1 time: 0.773995 Aug 04 21:27:55.211147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 197/383] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:27:54 2022] DELETE /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:27:55.231535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:55.232249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:55.239627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:55.245097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:55.245097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:55.245097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:55.245097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:55.245698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:55.303416 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:55.322414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0be7d5bf-90cf-425c-a8f2-e03b39f3ffa6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.173692 Aug 04 21:27:55.322414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 187/384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:55 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:55.438339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:55.447823 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e03708ba-e3ad-4128-8cf3-e9e8de928435 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1503 microversion: 2.1 time: 0.231873 Aug 04 21:27:55.448964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 198/385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:55 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:55.758647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:55.759587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:55.770069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:55.770564 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:55.771174 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:55.789510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:55.789510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:55.789510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:55.967827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:55.977380 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:55.979483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:55.981042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f6b0b79a-07a7-4ea8-8efc-42a2d7246bbe tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.231291 Aug 04 21:27:55.981627 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 188/386] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:55 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:56.337362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:56.338753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:56.345795 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:56.346604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:56.347105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:56.348451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:56.348940 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:56.349393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:56.472775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:56.474792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:56.483145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:56.484400 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:56.485106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:56.486154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:56.486820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:56.487525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:56.519088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:56.528701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9333ece7-6480-4ea6-9729-af2b1dd2c33c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.195689 Aug 04 21:27:56.530252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 199/387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:56 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:56.694974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:56.706922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7260013e-5a44-470c-9393-7dbc6893b778 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1503 microversion: 2.1 time: 0.240800 Aug 04 21:27:56.713268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 189/388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:56 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:57.010529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:57.011386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:57.021151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.021736 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.022214 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.023310 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.023878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.024635 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.047676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:57.191043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:57.202561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:57.204265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:57.205506 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d85d0908-95d8-4bbc-bcd5-830f6bf61eaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.199053 Aug 04 21:27:57.206396 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 200/389] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:57 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:57.556770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:57.557429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:57.567332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.567332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.568117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.569068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.569267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.569748 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.728548 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:57.729840 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:57.741098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.741881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.743420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.743420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.744052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.744666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.767153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:57.780826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-de0fdb13-2fc9-45ca-bb4c-827bf19c1cd5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.232696 Aug 04 21:27:57.795344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 190/390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:57 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:27:57.834162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:57.846515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a270a749-4fe2-4796-9944-e41548321888 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1461 microversion: 2.1 time: 0.121047 Aug 04 21:27:57.847342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 201/391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:57 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1461 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:57.902871 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-2042b1fa-c33a-48e0-96d5-9f07577352bd req-4fc25b8b-4c6e-4ec9-bc76-437543a85460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a61b7fc-1e5c-4121-ab1b-288e52cb7e42", "name": "network-vif-deleted", "tag": "f915a080-d83b-4b65-8199-c1422cd5ebef"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:27:57.913225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-2042b1fa-c33a-48e0-96d5-9f07577352bd req-4fc25b8b-4c6e-4ec9-bc76-437543a85460 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:57.913683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-2042b1fa-c33a-48e0-96d5-9f07577352bd req-4fc25b8b-4c6e-4ec9-bc76-437543a85460 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:57.914211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-2042b1fa-c33a-48e0-96d5-9f07577352bd req-4fc25b8b-4c6e-4ec9-bc76-437543a85460 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:57.928034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-2042b1fa-c33a-48e0-96d5-9f07577352bd req-4fc25b8b-4c6e-4ec9-bc76-437543a85460 service nova] Creating event network-vif-deleted:f915a080-d83b-4b65-8199-c1422cd5ebef for instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 on hv-cinder-85220 Aug 04 21:27:57.936253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-2042b1fa-c33a-48e0-96d5-9f07577352bd req-4fc25b8b-4c6e-4ec9-bc76-437543a85460 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035546 Aug 04 21:27:57.937336 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 191/392] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:27:58.255776 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:58.258633 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:58.265775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.266265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.266701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.267435 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.267889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.268305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.447001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:58.456167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:58.458227 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:58.459651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d3514fcb-2fe5-4082-82f9-53555eb3015a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.233178 Aug 04 21:27:58.460101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 202/393] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:58 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:58.807170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:58.808031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:58.815869 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.816906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.817284 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.817969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.818417 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.818858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.868278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:58.868914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:58.875255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.875782 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.876220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.876915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.877368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.877793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.912802 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:58.913317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:58.913752 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:58.914201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lazy-loading 'fault' on Instance uuid 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:27:58.961783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:58.969649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3be40fbc-ac17-42e9-84ee-8bfd28a3c650 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 200 len: 1304 microversion: 2.1 time: 0.105638 Aug 04 21:27:58.970226 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 203/394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:58 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:59.051566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:59.061980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9f8124a1-876c-47f5-b307-b69626d0c3e4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.259237 Aug 04 21:27:59.062812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 192/395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:58 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:27:59.484307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:59.484924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:27:59.498418 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:59.501599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:59.502101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:59.503009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:27:59.503493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:27:59.504195 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:27:59.663099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:59.673012 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:59.674609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:27:59.676504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-59b81a1b-61e6-479f-8cf9-f9b5c3234f44 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.195571 Aug 04 21:27:59.677083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 204/396] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:27:59 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:27:59.993944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:27:59.994564 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:00.008439 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.009162 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.012919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.012919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.012919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.012919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.032388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] HTTP exception thrown: Instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 could not be found. Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Request method failure captured: Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 HTTP/1.1 Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DnALNnNFisj63ptXBpaA8Z1LVWGSWU5NTeXP0t_PTGfoXjsy0fvarXh2F2jDcHWAJKEAo_8hAUpdD0dOPkJ355Etbxq1HmWXZBakBPyHzkTUHaUuqbYzRmebqFgWpk0eahGHTjqiX1IIu1tiTWO1fCp2M7-x4SKt9KQrCGOC6lOhWk Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: e734c237455f4d42b1e34eeb6ed38511 Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-VolumesActionsTest-2064747163 Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:28:00.034232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-VolumesActionsTest-2064747163 Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: e734c237455f4d42b1e34eeb6ed38511 Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-VolumesActionsTest-2064747163 Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-VolumesActionsTest-2064747163-project Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 1039d83bfa58450ebe10e727f1dc0ea5 Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-VolumesActionsTest-2064747163-project Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 could not be found. Aug 04 21:28:00.036067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '5a61b7fc-1e5c-4121-ab1b-288e52cb7e42'} Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 could not be found. Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:28:00.037066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 could not be found. Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 could not be found. Aug 04 21:28:00.038314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:00.040908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Returning 404 to user: Instance 5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:28:00.041780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cddf60a6-447c-4c79-af56-83ac7793a7b1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42" status: 404 len: 111 microversion: 2.1 time: 0.051960 Aug 04 21:28:00.042478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 193/397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:27:59 2022] GET /compute/v2.1/servers/5a61b7fc-1e5c-4121-ab1b-288e52cb7e42 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:28:00.090694 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:00.091302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:00.097650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.098356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.098955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.099553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.100013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.100438 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.146862 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-147614273", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "networks": [{"uuid": "adca7506-b553-4007-86bc-9e2332e869ba"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:00.212869 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] validate_networks() for [('adca7506-b553-4007-86bc-9e2332e869ba', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:28:00.276743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:00.287980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6ea5645c-be49-4431-b8ab-c587c767258b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.201056 Aug 04 21:28:00.288567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 205/398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:00 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:00.591629 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:28:00.592049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:28:00.592528 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:28:00.592933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:28:00.593348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:28:00.603216 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.603729 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.605127 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.605127 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.605343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.605755 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.623335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Getting quotas for project e734c237455f4d42b1e34eeb6ed38511. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:28:00.626049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:00.628423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Getting quotas for user 1039d83bfa58450ebe10e727f1dc0ea5 and project e734c237455f4d42b1e34eeb6ed38511. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:28:00.640058 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:28:00.642504 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:28:00.699838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:00.700440 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:00.706322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.707405 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.707846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.708530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:00.708982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:00.709404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:00.760128 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3db847d0-8e82-4790-b81b-dd36415da6a6 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617256 Aug 04 21:28:00.760776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 194/399] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:28:00.772828 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d0b8bde9-240c-48f2-a372-e8a7729500ec tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:00.773445 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d0b8bde9-240c-48f2-a372-e8a7729500ec tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:00.854258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d0b8bde9-240c-48f2-a372-e8a7729500ec tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:00.862744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d0b8bde9-240c-48f2-a372-e8a7729500ec tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1213 microversion: 2.1 time: 0.094823 Aug 04 21:28:00.874682 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 195/400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:00 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:00.881435 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:00.889117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:00.890620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:00.891872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-923333d2-2c2e-45bc-b67b-ea9195487c03 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1741 microversion: 2.20 time: 0.195906 Aug 04 21:28:00.892432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 206/401] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:00 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:01.310295 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:01.311689 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:01.322394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:01.326858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:01.326858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:01.326858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:01.326858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:01.327210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:01.783983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:01.796898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-daa77066-54fb-4d20-981b-567e2f771998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.490791 Aug 04 21:28:01.798113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 196/402] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:01 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:01.888420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:01.896113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:01.919559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:01.919559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:01.919559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:01.919559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:01.919926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:01.919926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:01.920056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:01.920056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:01.925720 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:01.926354 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:01.926865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:01.928156 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:01.928156 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:01.928718 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:01.991489 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:01.999176 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-524ace36-e39b-4c9f-af7c-2d3db84ebacd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1217 microversion: 2.1 time: 0.114463 Aug 04 21:28:02.003409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 207/403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:01 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:02.152037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:02.160728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:02.162269 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:02.163441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e9b5fd66-d822-4c3c-b063-cae349db22df tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1723 microversion: 2.20 time: 0.251439 Aug 04 21:28:02.163998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 197/404] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:01 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:02.819979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:02.820553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:02.826747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:02.827230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:02.827709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:02.828397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:02.828850 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:02.829271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:02.961924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:02.970437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b2b428f6-9f58-4fff-a159-68742913e02c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.154981 Aug 04 21:28:02.970895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 208/405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:02 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:03.020244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:03.020848 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:03.027785 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:03.028271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:03.028701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:03.029405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:03.029869 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:03.030525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:03.096317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:03.103849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e908128d-2078-48d9-9f63-f8fa54c178ba tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1209 microversion: 2.1 time: 0.087415 Aug 04 21:28:03.104483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 198/406] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:03 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:03.187787 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:03.188397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:03.196649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:03.197129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:03.197554 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:03.198243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:03.198688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:03.199106 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:03.347435 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:03.355593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:03.357094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:03.358241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-402b41d4-bd01-43c5-b89f-c68379d011f6 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1723 microversion: 2.20 time: 0.174523 Aug 04 21:28:03.358790 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 209/407] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:03 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:03.992045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:03.992883 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:03.999110 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:03.999644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.000074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.000920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.001376 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.001794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.131896 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:04.132989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:04.143145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:04.149829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.150972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.151522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.152314 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.153250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.153250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.154008 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fffc79ac-0f72-4ed3-8071-71d5bbe011e3 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1725 microversion: 2.1 time: 0.166452 Aug 04 21:28:04.155179 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 199/408] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:03 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:04.235364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:04.244283 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f734d309-9a6b-4e2d-adc9-77b6ec95d921 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1265 microversion: 2.1 time: 0.121792 Aug 04 21:28:04.244854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 210/409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:04 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:04.381335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:04.381855 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:04.387827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.389963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.389963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.389963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.389963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.390375 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.533638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:04.537918 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:04.543897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:04.546732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:04.546732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-29179255-19fe-4652-b4a3-cd35a92e4335 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1726 microversion: 2.20 time: 0.169375 Aug 04 21:28:04.547267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 200/410] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:04 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:04.570297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdb0c04b-619c-4d0d-b02c-c588daa84ce4"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:04.572808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:04.580433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.580911 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.581339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.582586 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.583026 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.583471 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-d742820f-881c-4223-b78e-cbeeff02c084 req-ca15b3b1-6e4b-4bab-a5f0-377b9022abfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "name": "network-vif-unplugged", "status": "completed", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:04.785888 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d742820f-881c-4223-b78e-cbeeff02c084 req-ca15b3b1-6e4b-4bab-a5f0-377b9022abfb service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:04.786351 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d742820f-881c-4223-b78e-cbeeff02c084 req-ca15b3b1-6e4b-4bab-a5f0-377b9022abfb service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:04.786770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-d742820f-881c-4223-b78e-cbeeff02c084 req-ca15b3b1-6e4b-4bab-a5f0-377b9022abfb service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:04.798030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-d742820f-881c-4223-b78e-cbeeff02c084 req-ca15b3b1-6e4b-4bab-a5f0-377b9022abfb service nova] Creating event network-vif-unplugged:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:28:04.803816 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-d742820f-881c-4223-b78e-cbeeff02c084 req-ca15b3b1-6e4b-4bab-a5f0-377b9022abfb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032914 Aug 04 21:28:04.804412 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 201/411] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:05.178353 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:05.179082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:05.186667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.188597 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.188597 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.188597 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.195945 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.201429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.407774 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:05.422318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5e329596-2953-4ee2-8c18-b74352aaf057 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1702 microversion: 2.1 time: 0.249357 Aug 04 21:28:05.435819 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 202/412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:05 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1702 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:05.455086 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:05.455916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:05.465980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.467657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.468715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.470148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.471305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.472220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.564470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:05.573557 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8dffef34-96e7-4e04-990b-8fd827601e23 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1271 microversion: 2.1 time: 0.135717 Aug 04 21:28:05.574145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 203/413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:05 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:05.578657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-733034e1-58aa-4b55-8b2a-7a6fa19fbc3b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:05.585270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-733034e1-58aa-4b55-8b2a-7a6fa19fbc3b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.585745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-733034e1-58aa-4b55-8b2a-7a6fa19fbc3b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.586183 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-733034e1-58aa-4b55-8b2a-7a6fa19fbc3b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.609417 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-733034e1-58aa-4b55-8b2a-7a6fa19fbc3b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Going to try to start instance {{(pid=118550) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 21:28:05.780114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c76cb6a0-92b4-44c5-954c-a7081ef5e33d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.214292 Aug 04 21:28:05.780788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 211/414] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Aug 4 21:28:04 2022] POST /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments => generated 188 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:28:05.813081 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-733034e1-58aa-4b55-8b2a-7a6fa19fbc3b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action" status: 202 len: 0 microversion: 2.1 time: 0.237659 Aug 04 21:28:05.813987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 204/415] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:28:05 2022] POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:28:05.824465 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:05.825069 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:05.836303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.837024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.837506 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.838265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.838718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.839173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.959449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:05.959449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:05.959449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.959449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.960792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.961670 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:05.962358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:05.963153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:05.996883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:06.005479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b3c878e4-677e-42ea-8f96-5c87714a81a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1711 microversion: 2.1 time: 0.186040 Aug 04 21:28:06.006058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 212/416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:05 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:06.019142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118550) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:28:06.333867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b480d45f-d536-4cff-ad24-d4ed79e53484 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/action" status: 202 len: 0 microversion: 2.20 time: 0.391103 Aug 04 21:28:06.335522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 205/417] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Aug 4 21:28:05 2022] POST /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:28:06.349420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:06.350044 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:06.353836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:06.359494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:06.360197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:06.361396 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:06.362660 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:06.363765 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:06.364412 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:06.595668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:06.597951 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:06.605504 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:06.606334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:06.606967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:06.608112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:06.608735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:06.609322 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:06.643120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:06.665789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:06.671756 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:06.672966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-57095e29-3e23-4f42-9400-5f51151a7de5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1752 microversion: 2.20 time: 0.330910 Aug 04 21:28:06.673525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 213/418] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:06 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1752 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:06.837263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:06.853332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-57bdb17d-04fb-4db9-87b8-d659ce990692 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.261557 Aug 04 21:28:06.853983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 206/419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:06 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:06.946846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-839b3416-5a40-423d-a27c-4330faa50534 req-857415c7-400a-444f-bf21-715328ed5c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b583337-78f0-4f62-8814-d698bfa41005", "tag": "67540bb9-2c3a-4cb8-b3cf-01cf2ef10c26"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:06.956538 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-839b3416-5a40-423d-a27c-4330faa50534 req-857415c7-400a-444f-bf21-715328ed5c9a service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:06.957528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-839b3416-5a40-423d-a27c-4330faa50534 req-857415c7-400a-444f-bf21-715328ed5c9a service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:06.957963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-839b3416-5a40-423d-a27c-4330faa50534 req-857415c7-400a-444f-bf21-715328ed5c9a service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:06.962209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:06.969125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-839b3416-5a40-423d-a27c-4330faa50534 req-857415c7-400a-444f-bf21-715328ed5c9a service nova] Creating event network-changed:67540bb9-2c3a-4cb8-b3cf-01cf2ef10c26 for instance 5b583337-78f0-4f62-8814-d698bfa41005 on hv-cinder-85220 Aug 04 21:28:06.974976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-839b3416-5a40-423d-a27c-4330faa50534 req-857415c7-400a-444f-bf21-715328ed5c9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031978 Aug 04 21:28:06.975630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 214/420] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:07.028108 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:07.029176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:07.038584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:07.039265 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:07.040025 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:07.045493 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:07.046879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:07.053410 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:07.336021 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:07.344727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-92ada07b-bd88-491a-b037-23eabefdf775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1711 microversion: 2.1 time: 0.322201 Aug 04 21:28:07.348286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 207/421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:07 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1711 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:07.699528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:07.700211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:07.707067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:07.707571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:07.708006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:07.708683 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:07.709124 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:07.709616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:07.849969 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:07.858601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:07.860166 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:07.861459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6bbe8de0-f1e5-488a-b3f4-75ff73a3fe3a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1752 microversion: 2.20 time: 0.167154 Aug 04 21:28:07.862006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 215/422] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:07 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:07.877392 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:07.877392 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:07.885501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:07.889609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:07.889609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:07.889609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:07.889609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:07.889978 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:08.131369 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:08.139359 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-871f4c11-adc0-4cde-9ce8-722d9bb5e5f5 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.267732 Aug 04 21:28:08.139929 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 208/423] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:07 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:08.367011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:08.368593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:08.379058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:08.381163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:08.381163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:08.381743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:08.382522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:08.383218 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:08.529895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:08.539474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3062e1b4-8256-4b51-b49b-288154e91848 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1715 microversion: 2.1 time: 0.177232 Aug 04 21:28:08.540055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 216/424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:08 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1715 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:08.893126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:08.893865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:08.901189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:08.901671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:08.902096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:08.902781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:08.903225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:08.903662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:09.046378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:09.055839 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:09.057339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:09.059168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d95a2073-db6d-496c-a325-3f4249a3965a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1754 microversion: 2.20 time: 0.171369 Aug 04 21:28:09.059761 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 209/425] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:08 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:09.161653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:09.162264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:09.168515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:09.169000 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:09.169433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:09.170119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:09.170571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:09.170994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:09.351300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:09.358891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-80fbd335-15cd-4f4e-884c-bed148aaef2d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.201745 Aug 04 21:28:09.359504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 217/426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:09 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:10.097262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:10.098060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:10.104635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:10.105108 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:10.105538 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:10.106220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:10.106671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:10.107091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:10.242932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:10.251916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:10.253398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:10.254590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-45b390a7-babb-44b3-b40f-e88eeaff584c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1754 microversion: 2.20 time: 0.161302 Aug 04 21:28:10.255582 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 210/427] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:10 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:10.380980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:10.381594 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:10.389093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:10.389958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:10.391706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:10.392964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:10.394004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:10.395358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:10.558664 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:10.569740 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-60fa8246-25ed-4655-bf76-1632ef3f6876 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.193256 Aug 04 21:28:10.570753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 218/428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:10 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:11.278436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:11.279045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:11.281023 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:11.281693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=8 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:11.290594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:11.291548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:11.292653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:11.293869 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:11.295264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:11.296512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:11.528509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:11.538374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:11.540350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:11.541832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b9fd50f0-231d-482b-9de3-d210599c55b4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.267039 Aug 04 21:28:11.542595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 211/429] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:11 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:11.594056 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:11.594668 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:11.601894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:11.602375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:11.602817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:11.603535 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:11.603987 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:11.604407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:11.744164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:11.759140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9a4d02d4-0944-4fc3-a1fc-fb9b8c5cc172 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.168467 Aug 04 21:28:11.760206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 219/430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:11 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:12.564871 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:12.565472 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:12.572243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:12.572721 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:12.573151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:12.573837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:12.574284 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:12.574716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:12.721266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:12.740056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:12.740056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:12.740056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-18015181-055e-4049-8a0c-4e903d3f4317 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.178319 Aug 04 21:28:12.745012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 212/431] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:12 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:12.783145 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:12.785585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:12.794875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:12.796006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:12.796941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:12.797996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:12.798913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:12.800176 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:13.013591 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-346a14fb-7003-4e54-b691-54ec746b2ea4 req-d568fa35-f79a-4b65-8006-0506868cda57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b583337-78f0-4f62-8814-d698bfa41005", "name": "network-vif-plugged", "status": "completed", "tag": "67540bb9-2c3a-4cb8-b3cf-01cf2ef10c26"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:13.047723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-346a14fb-7003-4e54-b691-54ec746b2ea4 req-d568fa35-f79a-4b65-8006-0506868cda57 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:13.048388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-346a14fb-7003-4e54-b691-54ec746b2ea4 req-d568fa35-f79a-4b65-8006-0506868cda57 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:13.048941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-346a14fb-7003-4e54-b691-54ec746b2ea4 req-d568fa35-f79a-4b65-8006-0506868cda57 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:13.072019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:13.080900 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a164ffe0-cf09-4426-8778-a08717513628 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.302171 Aug 04 21:28:13.082886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 220/432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:12 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:13.104911 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-346a14fb-7003-4e54-b691-54ec746b2ea4 req-d568fa35-f79a-4b65-8006-0506868cda57 service nova] Creating event network-vif-plugged:67540bb9-2c3a-4cb8-b3cf-01cf2ef10c26 for instance 5b583337-78f0-4f62-8814-d698bfa41005 on hv-cinder-85220 Aug 04 21:28:13.112501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-346a14fb-7003-4e54-b691-54ec746b2ea4 req-d568fa35-f79a-4b65-8006-0506868cda57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102451 Aug 04 21:28:13.114140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 213/433] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:13.767673 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:13.768269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:13.774308 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:13.774779 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:13.775200 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:13.776000 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:13.776445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:13.776862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:13.930532 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:13.940276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:13.942889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:13.944652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d9640fe9-4440-4df8-a2bb-654ba6503464 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.180624 Aug 04 21:28:13.945222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 221/434] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:13 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:14.108632 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:14.110069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:14.118036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:14.118847 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:14.119561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:14.120466 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:14.121123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:14.121770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:14.303310 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:14.312448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1b248899-6f96-4a7e-872e-652920107754 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.208339 Aug 04 21:28:14.313184 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 214/435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:14 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:14.968234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:14.968942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:14.976462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:14.976953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:14.977399 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:14.978090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:14.978546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:14.978969 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:15.130878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:15.141724 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:15.144606 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:15.145847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-264bd974-09ea-4238-b27c-960952065599 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.181505 Aug 04 21:28:15.146697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 222/436] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:14 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:15.336361 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:15.337021 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:15.346804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:15.348171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:15.348626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:15.349719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:15.350180 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:15.350609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:15.531051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:15.540646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7e3a519c-4a3f-480e-899d-c8ed4c2d9a75 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.210036 Aug 04 21:28:15.542009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 215/437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:15 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:16.169993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:16.171493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:16.179867 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:16.180469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:16.180909 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:16.181638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:16.182083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:16.182500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:16.365850 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:16.375168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:16.377377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:16.378942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1727b675-8909-4a1d-b2a0-aff446585597 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.213167 Aug 04 21:28:16.390979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 223/438] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:16 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:16.562009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:16.562633 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:16.570165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:16.570647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:16.571078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:16.571809 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:16.572260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:16.572681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:16.717826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:16.732131 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:16.743054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fa1beb3f-49a1-4eda-b58b-1a30e673ea4d tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.184809 Aug 04 21:28:16.743693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 216/439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:16 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:17.402087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:17.402740 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:17.411130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:17.411878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:17.412293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:17.413150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:17.413947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:17.414526 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:17.586131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:17.595296 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:17.596860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:17.598661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e14bc1a4-8a28-47a4-aed4-2c64466d39e0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.200550 Aug 04 21:28:17.599263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 224/440] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:17 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:17.764469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:17.765979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:17.777921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:17.778346 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:17.778783 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:17.783635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:17.784282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:17.784708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:17.945698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:17.954206 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-849af148-2849-43cc-9b76-d8a0381543a7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.193920 Aug 04 21:28:17.955434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 217/441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:17 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:18.623357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:18.623985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:18.630907 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:18.631406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:18.631840 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:18.632522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:18.632974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:18.633393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:18.807996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:18.823126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:18.825276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:18.826804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-15beed7e-1463-406b-8138-c11dfb218791 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.208825 Aug 04 21:28:18.839361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 225/442] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:18 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:18.977830 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:18.979252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:18.986834 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:18.988763 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:18.989601 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:18.990504 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:18.991152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:18.991762 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:19.159244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:19.168324 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-01485031-92f9-4c3f-9125-574b00dc7580 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.196033 Aug 04 21:28:19.182369 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 218/443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:18 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:19.857854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:19.857854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:19.862066 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:19.862591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:19.863062 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:19.863855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:19.864338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:19.867782 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:20.062243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:20.072777 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:20.074550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:20.076149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9f497d73-edba-4328-8641-6a4747e824d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.227767 Aug 04 21:28:20.089418 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 226/444] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:19 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:20.192987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:20.194252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:20.201529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:20.202328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:20.202941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:20.203684 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:20.204135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:20.204553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:20.381455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:20.390204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7918df9f-0703-4ad8-ab85-912f43c8c89b tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.203632 Aug 04 21:28:20.391424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 219/445] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:20 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:21.103276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:21.105258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:21.116720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:21.117205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:21.122698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:21.123574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:21.124050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:21.124484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:21.289860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:21.307515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:21.307515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:21.307515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-912c2ecb-68a4-431c-a76a-d2d0d9bd71c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.204396 Aug 04 21:28:21.307937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 227/446] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:21 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:21.412313 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:21.419112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:21.422568 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:21.423566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:21.424363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:21.425899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:21.426593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:21.427167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:21.594113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:21.602921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3a1734a0-96c0-41d6-9a3e-3fad59ff4582 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.194961 Aug 04 21:28:21.605016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 220/447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:21 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:22.328741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:22.329342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:22.337085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:22.339091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:22.339091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:22.339091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:22.339393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:22.339580 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:22.473638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:22.482502 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:22.483979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:22.485332 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-07bee023-255f-4df9-9cc5-407566edf426 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.160386 Aug 04 21:28:22.486458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 228/448] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:22 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:22.623578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:22.624270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:22.631131 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:22.632054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:22.632910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:22.633728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:22.634242 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:22.634730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:22.775057 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:22.782214 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ca208631-b20c-495a-8075-156cbdd75352 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.162543 Aug 04 21:28:22.782720 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 221/449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:22 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:23.510662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:23.511607 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:23.520706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:23.521774 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:23.522499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:23.523914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:23.524867 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:23.525678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:23.745898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:23.754433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:23.755967 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:23.757241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8aa558d9-e4d9-464d-abcf-50820178b54b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.251475 Aug 04 21:28:23.757813 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 229/450] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:23 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:23.803202 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:23.804011 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:23.810449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:23.810938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:23.811396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:23.812090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:23.812551 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:23.812974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:24.288296 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:24.296154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e3eeb942-dec4-4ed2-b50e-09d2fe18d80c tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.496759 Aug 04 21:28:24.296731 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 222/451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:23 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:24.782460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:24.783271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:24.791085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:24.791841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:24.792446 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:24.794173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:24.794173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:24.794173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:24.982108 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:25.008838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:25.010383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:25.012049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8eb9e937-3678-4f99-aa88-b177a0baae8a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.233738 Aug 04 21:28:25.012926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 230/452] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:24 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:25.318301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:25.318897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:25.341062 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:25.341549 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:25.341974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:25.342674 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:25.343363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:25.343926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:25.492106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:25.499518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-825c68d2-8db4-4aec-bb13-82b7fd99b340 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1313 microversion: 2.1 time: 0.186163 Aug 04 21:28:25.505963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 223/453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:25 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:26.036732 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:26.037344 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:26.043741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:26.044217 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:26.044830 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:26.045521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:26.046127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:26.046720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:26.066394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:26.296334 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:26.309083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:26.310844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:26.312153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7b9d44a3-d08f-48b0-82b9-25873552aa5b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.279932 Aug 04 21:28:26.312860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 231/454] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:26 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:26.521010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:26.521598 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:26.528882 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:26.529460 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:26.529897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:26.530606 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:26.531055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:26.531517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:26.670927 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:26.679867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c019744d-f1e6-461a-a696-14686a41a370 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1497 microversion: 2.1 time: 0.162939 Aug 04 21:28:26.680456 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 224/455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:26 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:27.338058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:27.339279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:27.348897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.349400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.349826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.350709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.351547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.352054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.509665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:27.518650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:27.520743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:27.521912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0634041e-5a11-4942-b11c-0a2800ba7208 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.189162 Aug 04 21:28:27.522468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 232/456] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:27 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:27.593818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:27.594296 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:27.602346 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.602836 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.603266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.604189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.604806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.605229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.635768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:28:27.801778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:27.803228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:27.813095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.813877 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.814456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.815494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.819773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.819773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.863421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3f9814e6-b526-4db1-95c1-4d87300207f8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/ips" status: 200 len: 148 microversion: 2.1 time: 0.068631 Aug 04 21:28:27.864710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 233/457] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:28:27 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/ips => generated 148 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:28:27.882164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad9eba71-edac-49b0-a32f-e788138bd520"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:27.885524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:27.893960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.895284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.896054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.897222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:27.897993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:27.898721 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:27.959194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a324e753-57b4-431f-b03a-a5557b131cbd tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 204 len: 0 microversion: 2.1 time: 0.368924 Aug 04 21:28:27.959814 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 225/458] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:28:27 2022] DELETE /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:28:27.980929 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:27.982791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:28.005472 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.005761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Invalid volume: volume ad9eba71-edac-49b0-a32f-e788138bd520 is already attached to instances: cb24b55d-a68c-42ce-b470-6e1ed385c48a Aug 04 21:28:28.006272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: POST /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/os-volume_attachments HTTP/1.1 Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 74 Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:28:28.007699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {"volumeAttachment": {"volumeId": "ad9eba71-edac-49b0-a32f-e788138bd520"}} Aug 04 21:28:28.009017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Invalid volume: volume ad9eba71-edac-49b0-a32f-e788138bd520 is already attached to instances: cb24b55d-a68c-42ce-b470-6e1ed385c48a Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'server_id': '11110c93-a770-4efa-baa5-8fa3eb3290b4', 'body': {'volumeAttachment': {'volumeId': 'ad9eba71-edac-49b0-a32f-e788138bd520'}}} Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ad9eba71-edac-49b0-a32f-e788138bd520 is already attached to instances: cb24b55d-a68c-42ce-b470-6e1ed385c48a Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:28.009772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ad9eba71-edac-49b0-a32f-e788138bd520 is already attached to instances: cb24b55d-a68c-42ce-b470-6e1ed385c48a Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:28.010901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:28.013600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:28.013600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:28:28.013600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:28:28.013600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ad9eba71-edac-49b0-a32f-e788138bd520 is already attached to instances: cb24b55d-a68c-42ce-b470-6e1ed385c48a Aug 04 21:28:28.013600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:28.014277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.014277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.014277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.014277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.014827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 400 to user: Invalid volume: volume ad9eba71-edac-49b0-a32f-e788138bd520 is already attached to instances: cb24b55d-a68c-42ce-b470-6e1ed385c48a {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:28:28.014827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0fd1013d-c4e5-4e2e-b34a-f546c15422bf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140907 Aug 04 21:28:28.029849 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 234/459] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:28:27 2022] POST /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 21:28:28.034751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:28.035245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:28.048443 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.048933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.049361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.050113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.050564 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.050990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.090252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:28:28.274305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:28.282328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a57fabc5-73e5-4b12-a137-ae5256db6da7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1503 microversion: 2.1 time: 0.315428 Aug 04 21:28:28.282909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 226/460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:27 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:28.398834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-29848ddb-fbf0-4832-a619-349ca5dcc44d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 204 len: 0 microversion: 2.1 time: 0.367526 Aug 04 21:28:28.399815 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 235/461] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:28:28 2022] DELETE /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:28:28.411188 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:28.412014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:28.418421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.418919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.419477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.420076 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.420541 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.420964 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.552304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:28.563355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:28.584122 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.585070 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.585713 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.586669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:28.587496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:28.588163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:28.652042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:28.674818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2331139f-f80f-4fe7-82a9-aaca67d72714 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1679 microversion: 2.1 time: 0.270692 Aug 04 21:28:28.675739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 227/462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:28 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1679 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:28.779410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:28.790530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:28.792330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:28.793976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9a52d9df-77ff-4378-9fb9-80c99e401f9e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.252280 Aug 04 21:28:28.795331 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 236/463] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:28 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:29.303448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:29.304046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:29.309954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:29.310406 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:29.310829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:29.311540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:29.311983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:29.312436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:29.453254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:29.467597 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e84ffba5-a172-4881-a219-6e796fa30aef tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1503 microversion: 2.1 time: 0.167971 Aug 04 21:28:29.468393 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 228/464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:29 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:29.702290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:29.702895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:29.724288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:29.724288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:29.724288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:29.724288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:29.724629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:29.724629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:29.818650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:29.819949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:29.829347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:29.829599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:29.829970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:29.830685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:29.831142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:29.831624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:29.885937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:29.896867 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-892c87e4-8244-4d78-ab17-8f00c22018dc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1679 microversion: 2.1 time: 0.197941 Aug 04 21:28:29.897536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 237/465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:29 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:30.007070 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:30.016415 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:30.017923 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:30.019306 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4856586a-41d5-490b-af26-a49156c7deaa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.206542 Aug 04 21:28:30.023356 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 229/466] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:29 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:30.489140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:30.489753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:30.496278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:30.496829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:30.497297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:30.498060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:30.499465 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:30.499936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:30.646628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:30.656074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-df1e6a71-c9db-4c55-a1fe-2d56948fa289 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1503 microversion: 2.1 time: 0.171432 Aug 04 21:28:30.656641 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 238/467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:30 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:30.918308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:30.918986 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:30.924703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:30.927232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:30.927846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:30.928266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:30.928956 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:30.929497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:30.929913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:31.043175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:31.043821 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:31.052149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:31.052632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:31.053102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:31.053769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:31.054223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:31.054646 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:31.111194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:31.120488 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b226f9b9-bb72-4808-ab73-702cd4e1fb9e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1679 microversion: 2.1 time: 0.206061 Aug 04 21:28:31.122026 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 230/468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:30 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:31.224872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:31.240869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:31.243178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:31.245872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-66efae95-cebb-4181-9668-7d1e559b22f0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.206499 Aug 04 21:28:31.263851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 239/469] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:31 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:31.685491 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:31.687228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:31.720151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:31.725695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:31.729919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:31.729919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:31.730225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:31.730870 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:31.975433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:31.981243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:31.995129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2e223974-acd6-430b-9c93-e881b06a6a13 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1503 microversion: 2.1 time: 0.317991 Aug 04 21:28:32.002035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 231/470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:31 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:32.146713 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:32.148575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:32.170205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:32.170977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:32.171351 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:32.180651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:32.188169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:32.188169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:32.274878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:32.275787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:32.284283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:32.285891 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:32.286480 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:32.287385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:32.288005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:32.288688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:32.531094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:32.542319 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-653eba81-54a2-4091-ad99-a5ce854ba1be tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1679 microversion: 2.1 time: 0.401331 Aug 04 21:28:32.542826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 240/471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:32 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1679 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:32.713434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:32.725115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:32.726989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:32.728264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-918fa552-d712-457a-b560-5f5d69271a22 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.461114 Aug 04 21:28:32.732160 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 232/472] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:32 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:33.027814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:33.028553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:33.040986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.041488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.041948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:33.042672 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.043452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.043978 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:33.357917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:33.368757 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-74a63467-ed08-4665-98b1-9b24119381d7 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1461 microversion: 2.1 time: 0.345218 Aug 04 21:28:33.371579 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 241/473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:33 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1461 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:33.569887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:33.571534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:33.580624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.581191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.581899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:33.582704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.583233 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.583860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:33.622575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-4a8e0ce5-39bb-4a44-94c5-c928ff820010 req-98753b9e-fca0-4439-89a6-862e464a5de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b583337-78f0-4f62-8814-d698bfa41005", "name": "network-vif-deleted", "tag": "67540bb9-2c3a-4cb8-b3cf-01cf2ef10c26"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:33.638673 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-4a8e0ce5-39bb-4a44-94c5-c928ff820010 req-98753b9e-fca0-4439-89a6-862e464a5de7 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.639946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-4a8e0ce5-39bb-4a44-94c5-c928ff820010 req-98753b9e-fca0-4439-89a6-862e464a5de7 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.640447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-4a8e0ce5-39bb-4a44-94c5-c928ff820010 req-98753b9e-fca0-4439-89a6-862e464a5de7 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:33.655597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-4a8e0ce5-39bb-4a44-94c5-c928ff820010 req-98753b9e-fca0-4439-89a6-862e464a5de7 service nova] Creating event network-vif-deleted:67540bb9-2c3a-4cb8-b3cf-01cf2ef10c26 for instance 5b583337-78f0-4f62-8814-d698bfa41005 on hv-cinder-85220 Aug 04 21:28:33.662865 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-4a8e0ce5-39bb-4a44-94c5-c928ff820010 req-98753b9e-fca0-4439-89a6-862e464a5de7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044832 Aug 04 21:28:33.664338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 242/474] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:28:33.756122 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:33.756828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:33.776995 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.791862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.792738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:33.793894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:33.794585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:33.795255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:34.041646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:34.058824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9ef6d2ef-58b8-43b1-a479-fe7ceb6add74 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1679 microversion: 2.1 time: 0.493607 Aug 04 21:28:34.063962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 233/475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:33 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1679 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:34.129852 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:34.149901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:34.155932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:34.160800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0d6bda42-d6b4-47df-aecd-e4e22098672e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.412820 Aug 04 21:28:34.164286 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 243/476] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:33 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:34.290289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-a9153c46-d140-445e-a76a-a374ffc25b12 req-7d051b50-1aaf-4bbd-b7ea-3b80f63fea87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11110c93-a770-4efa-baa5-8fa3eb3290b4", "name": "network-vif-deleted", "tag": "5355b20d-dfe0-4e8f-a1a8-57247178bffa"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:34.307877 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a9153c46-d140-445e-a76a-a374ffc25b12 req-7d051b50-1aaf-4bbd-b7ea-3b80f63fea87 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:34.310149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a9153c46-d140-445e-a76a-a374ffc25b12 req-7d051b50-1aaf-4bbd-b7ea-3b80f63fea87 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:34.310149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a9153c46-d140-445e-a76a-a374ffc25b12 req-7d051b50-1aaf-4bbd-b7ea-3b80f63fea87 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:34.324112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-a9153c46-d140-445e-a76a-a374ffc25b12 req-7d051b50-1aaf-4bbd-b7ea-3b80f63fea87 service nova] Creating event network-vif-deleted:5355b20d-dfe0-4e8f-a1a8-57247178bffa for instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 on hv-cinder-85220 Aug 04 21:28:34.331857 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-a9153c46-d140-445e-a76a-a374ffc25b12 req-7d051b50-1aaf-4bbd-b7ea-3b80f63fea87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046496 Aug 04 21:28:34.333248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 234/477] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:34.391130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:34.391826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:34.401764 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:34.404971 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:34.405566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:34.406295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:34.413024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:34.413744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:34.464450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:34.464986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:34.466745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:34.467206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lazy-loading 'fault' on Instance uuid 5b583337-78f0-4f62-8814-d698bfa41005 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:28:34.524160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1039d83bfa58450ebe10e727f1dc0ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e734c237455f4d42b1e34eeb6ed38511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:34.557267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-11d24f18-c2af-4ece-9908-014326c44cf1 tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 200 len: 1303 microversion: 2.1 time: 0.160847 Aug 04 21:28:34.563209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 244/478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:34 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:35.088726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:35.090408 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:35.110426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.111167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.114716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.115281 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.116794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.118672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.194155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:35.194762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:35.205516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.206434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.207071 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.207720 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'fault' on Instance uuid 11110c93-a770-4efa-baa5-8fa3eb3290b4 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:28:35.211036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.211564 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.211985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.212695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.213143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.213561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.336305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:35.351934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-424ea1d4-5cbe-464c-ae5b-5df9d1d521fd tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 200 len: 1330 microversion: 2.1 time: 0.271446 Aug 04 21:28:35.357448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 235/479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:35 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 1330 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:35.402529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98a81a58-5029-4df8-9f6e-1e07000e2cac"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:35.405502 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:35.417932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.419942 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.424077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.428295 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.429125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.455828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:35.471735 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:35.473951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:35.478549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-507df805-1b85-44a8-b1a6-62779a1086f8 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.289339 Aug 04 21:28:35.491624 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 245/480] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:35 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:35.649755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:35.649755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] [instance: 5b583337-78f0-4f62-8814-d698bfa41005] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:35.649755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.649755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.650599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.650599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:35.650599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:35.650599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] HTTP exception thrown: Instance 5b583337-78f0-4f62-8814-d698bfa41005 could not be found. Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Request method failure captured: Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 HTTP/1.1 Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DnALNnNFisj63ptXBpaA8Z1LVWGSWU5NTeXP0t_PTGfoXjsy0fvarXh2F2jDcHWAJKEAo_8hAUpdD0dOPkJ355Etbxq1HmWXZBakBPyHzkTUHaUuqbYzRmebqFgWpk0eahGHTjqiX1IIu1tiTWO1fCp2M7-x4SKt9KQrCGOC6lOhWk Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: e734c237455f4d42b1e34eeb6ed38511 Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesActionsTest-2064747163 Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:28:35.651507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e734c237455f4d42b1e34eeb6ed38511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesActionsTest-2064747163 Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: e734c237455f4d42b1e34eeb6ed38511 Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesActionsTest-2064747163 Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesActionsTest-2064747163-project Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 1039d83bfa58450ebe10e727f1dc0ea5 Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesActionsTest-2064747163-project Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 5b583337-78f0-4f62-8814-d698bfa41005 could not be found. Aug 04 21:28:35.653095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '5b583337-78f0-4f62-8814-d698bfa41005'} Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b583337-78f0-4f62-8814-d698bfa41005 could not be found. Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:28:35.654088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b583337-78f0-4f62-8814-d698bfa41005 could not be found. Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b583337-78f0-4f62-8814-d698bfa41005 could not be found. Aug 04 21:28:35.655437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:35.657038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] Returning 404 to user: Instance 5b583337-78f0-4f62-8814-d698bfa41005 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:28:35.657038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-05574949-08c3-4c9e-bfa1-a8a9f021f9fc tempest-VolumesActionsTest-2064747163 tempest-VolumesActionsTest-2064747163-project] 10.222.0.25 "GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005" status: 404 len: 111 microversion: 2.1 time: 0.057941 Aug 04 21:28:35.657038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 246/481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:35 2022] GET /compute/v2.1/servers/5b583337-78f0-4f62-8814-d698bfa41005 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:28:36.416679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:36.417581 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:36.439638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:36.442543 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:36.445382 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:36.447035 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:36.451168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:36.452941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:36.508201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 HTTP/1.1 Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:28:36.511898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:28:36.513550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '11110c93-a770-4efa-baa5-8fa3eb3290b4'} Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:28:36.514419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:28:36.515741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:28:36.526923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:28:36.527654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e78e0df6-e89f-4ba5-b943-01d74ef3a026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 404 len: 111 microversion: 2.1 time: 0.115985 Aug 04 21:28:36.528238 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 247/482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:36 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:28:36.549397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:36.550426 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:36.569183 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:36.569946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:36.570613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:36.578933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:36.579918 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:36.580584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:36.586858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-df1399de-eb7d-4354-8c60-d87ec22fef0f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.189523 Aug 04 21:28:36.591939 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 236/483] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:28:35 2022] POST /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments => generated 194 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:36.640047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-237ca318-afba-4b0a-80c7-d744ef79a45e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '.version_select at 0x7f8e71010310>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:36.649118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:36.794433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-237ca318-afba-4b0a-80c7-d744ef79a45e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523044164" status: 202 len: 0 microversion: 2.1 time: 0.205542 Aug 04 21:28:36.798591 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 237/484] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Aug 4 21:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523044164 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:28:36.879620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:36.891929 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:36.894036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:36.895500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-91730310-d4cb-4912-bda0-dcdb79845581 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.358855 Aug 04 21:28:36.897617 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 248/485] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:36 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:37.931865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:37.932991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:37.952254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:37.952254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:37.953193 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:37.954562 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:37.954845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:37.955848 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:38.208165 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:28:38.209402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Aug 04 21:28:38.438994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-04d98b17-75b7-4b54-988e-8da5e31b90ce tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Action: 'create', calling method: .version_select at 0x7f8e70ec2e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-951782273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQcFWpILGu0tH0ZW9ZCimhRxUZbIDJUObXNlo7UpvzPelw9+qtO+0DsGUXCFMkcNV5gpsVyrGyuFZHe76iz4PenP1Jv1tcMApIORNa0JYGYdq/zhspf0CZjYhAqPm+SnA=="}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:38.444736 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:38.458555 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-04d98b17-75b7-4b54-988e-8da5e31b90ce tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Getting quotas for project f1b4cfcf22614a95ad77db93922449cd. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:28:38.462660 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-04d98b17-75b7-4b54-988e-8da5e31b90ce tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Getting quotas for user f480dbdc7237420680584ce4866b36e9 and project f1b4cfcf22614a95ad77db93922449cd. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:28:38.486996 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:38.497069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:38.498588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:38.499812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f29e1ed2-99c7-4be8-bd37-44a6db605a6e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.578877 Aug 04 21:28:38.500858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 238/486] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:37 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:38.506546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:38.507024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:38.513384 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:38.513813 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:38.514255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:38.514987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:38.515434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:38.515859 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:38.559093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-04d98b17-75b7-4b54-988e-8da5e31b90ce tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.378156 Aug 04 21:28:38.565267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 249/487] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:28:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:38.647951 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'services' on Instance uuid cb24b55d-a68c-42ce-b470-6e1ed385c48a {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:28:38.907310 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9499bdf4-0e96-4fe6-a953-3bfe8e38d162 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments/ad9eba71-edac-49b0-a32f-e788138bd520" status: 202 len: 0 microversion: 2.1 time: 0.405429 Aug 04 21:28:38.908287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 239/488] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:28:38 2022] DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments/ad9eba71-edac-49b0-a32f-e788138bd520 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:28:38.919236 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:38.921510 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:38.930613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:38.931110 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:38.931625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:38.932344 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:38.932793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:38.933424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:38.967837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-72ca4a36-5d0a-478d-85c2-9a416e0c8883 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054014 Aug 04 21:28:38.968408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 250/489] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:38 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:39.526810 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:39.528747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:39.543070 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:39.543583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:39.544060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:39.544758 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:39.545203 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:39.545621 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:39.693219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:39.702081 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:39.703858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:39.705208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f4babe50-52fa-4210-b9ab-edf0f6993f91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.185408 Aug 04 21:28:39.705776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 240/490] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:39 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:39.980834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:39.989161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:39.990202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:39.990679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:39.991105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:39.991825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:39.992266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:39.993259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:40.028469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2a412952-1dbe-4eee-aede-2a8be2ebacbf tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051472 Aug 04 21:28:40.029290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 251/491] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:39 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:40.745480 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:40.746569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:40.756578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:40.757069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:40.757518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:40.758294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:40.758791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:40.759257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:40.926697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-39d57ea4-71a0-4024-ad87-92c652a145d3 req-7b631bca-da09-4059-a40f-a335140aaafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "name": "network-vif-plugged", "status": "completed", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:40.954031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-39d57ea4-71a0-4024-ad87-92c652a145d3 req-7b631bca-da09-4059-a40f-a335140aaafb service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:40.960147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-39d57ea4-71a0-4024-ad87-92c652a145d3 req-7b631bca-da09-4059-a40f-a335140aaafb service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:40.960764 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-39d57ea4-71a0-4024-ad87-92c652a145d3 req-7b631bca-da09-4059-a40f-a335140aaafb service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:40.978720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-39d57ea4-71a0-4024-ad87-92c652a145d3 req-7b631bca-da09-4059-a40f-a335140aaafb service nova] Creating event network-vif-plugged:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:28:40.986937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-39d57ea4-71a0-4024-ad87-92c652a145d3 req-7b631bca-da09-4059-a40f-a335140aaafb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064184 Aug 04 21:28:40.988368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 252/492] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:41.006494 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:41.026037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:41.028090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:41.030157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-03fbef7c-5e9a-4566-8690-402ff1c4818f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.290400 Aug 04 21:28:41.031827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 241/493] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:40 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:41.053010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:41.055451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:41.062935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:41.063588 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:41.064024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:41.064729 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:41.065254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:41.065772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:41.103635 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1cdb0a1f-693b-4244-89bf-c6ca1ef5d936 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064142 Aug 04 21:28:41.104449 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 253/494] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:41 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:42.060932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:42.061563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:42.092299 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:42.092791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:42.095626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:42.099088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:42.099613 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:42.100636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:42.118577 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:42.121495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:42.134688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:42.139300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:42.140421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:42.141392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:42.142066 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:42.142678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:42.212888 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b284494c-67b5-4f6a-8323-51c654f8fdb8 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098207 Aug 04 21:28:42.218458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 254/495] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:42 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:42.361028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:42.371851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:42.373947 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:42.375350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3baa5a01-c0be-4015-ba4b-b5521bf2c7de tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.323166 Aug 04 21:28:42.376084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 242/496] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:42 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:43.238844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:43.242240 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:43.260996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:43.261715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:43.262241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:43.263243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:43.263815 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:43.264373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:43.346371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-717cd3a1-434c-472b-9ba0-25285d716baa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123409 Aug 04 21:28:43.347011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 255/497] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:43 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:43.401363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:43.402340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:43.410758 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:43.411523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:43.412098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:43.413137 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:43.413809 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:43.414317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:43.600374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:43.611720 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:43.614994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:43.616938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-17af5d75-10be-441a-af3a-9837bcea0a8e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.220214 Aug 04 21:28:43.622225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 243/498] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:43 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:44.361582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:44.364409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:44.372785 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:44.374049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:44.374861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:44.376499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:44.377287 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:44.377776 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:44.414107 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-25cbd591-002d-4a1f-9d74-2a4052c096d1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056841 Aug 04 21:28:44.419262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 256/499] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:44 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:44.644973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:44.645678 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:44.654740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:44.658734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:44.658734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:44.658734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:44.658734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:44.659096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:44.882726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:44.907116 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:44.915212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:44.919340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c7f71bd6-33ae-4669-9577-fffa64bf1cc3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1810 microversion: 2.20 time: 0.278912 Aug 04 21:28:44.942106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 244/500] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:44 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1810 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:28:45.426566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:45.429015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:45.437182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:45.437667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:45.438098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:45.438930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:45.439592 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:45.440013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:45.483541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-90f086d9-1262-4305-bf11-28598ce08481 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060360 Aug 04 21:28:45.489271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 257/501] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:45 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:45.558698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:45.561466 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:45.569447 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:45.570227 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:45.570831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:45.571777 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:45.572375 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:45.572946 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:45.623964 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lazy-loading 'flavor' on Instance uuid fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:28:45.951746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:45.969207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:45.970067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:45.977691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:45.986800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:45.986800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:45.986800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:45.986800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:45.987304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.091101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-abd9d5df-d6e2-4375-bff4-fa74d61006e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/action" status: 200 len: 32 microversion: 2.1 time: 0.536595 Aug 04 21:28:46.094890 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 245/502] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:28:45 2022] POST /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/action => generated 32 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:28:46.105765 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:46.111566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:46.125540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:46.126066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:46.126547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.128300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:46.129437 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:46.129971 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.157458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:46.169311 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:46.171681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:46.173525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9c4d32ce-5597-4eb8-b95f-a310767e84c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1797 microversion: 2.20 time: 0.207961 Aug 04 21:28:46.174645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 258/503] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:28:45 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1797 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:28:46.369732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:46.384196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-297f968b-1d2b-4d49-bdd7-371ed7b7a920 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.284285 Aug 04 21:28:46.385610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 246/504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:46 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:46.511051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:46.520770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:46.552295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:46.555079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:46.557050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.559352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:46.561662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:46.564013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.627435 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2286fd13-3705-46e6-953b-017252ef057c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131789 Aug 04 21:28:46.629087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 259/505] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:28:46 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:28:46.723060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:46.724359 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:46.735238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:46.735961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:46.737011 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.738989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:46.739878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:46.740728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:46.790399 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:28:47.244006 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-99bd0db0-ccc6-4798-9193-496039475c0f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 204 len: 0 microversion: 2.1 time: 0.531486 Aug 04 21:28:47.246112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 247/506] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:28:46 2022] DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:28:47.255127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:47.255860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:47.262747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:47.263424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:47.263937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:47.264826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:47.265404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:47.265914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:47.415667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:47.416630 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:47.426280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:47.427171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:47.428068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:47.429670 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:47.429961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:47.430079 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:47.430616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:47.440195 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-94767f87-a4fb-4110-9671-d26707736d6c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1681 microversion: 2.1 time: 0.188833 Aug 04 21:28:47.442099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 260/507] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:47 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:47.608358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:47.619662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7c335822-3795-4298-93e2-9e494096842f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.211018 Aug 04 21:28:47.624600 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 248/508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:47 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:48.466173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:48.466882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:48.470639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=4 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:48.474938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:48.475523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:48.476039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:48.476961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:48.477474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:48.477901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:48.642750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:48.648533 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:48.649882 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:48.653790 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-177cfc1b-8776-42c2-a5a8-0429e0e31cd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1681 microversion: 2.1 time: 0.191809 Aug 04 21:28:48.654737 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 261/509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:48 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:48.666451 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:48.669294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:48.670923 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:48.671800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:48.672837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:48.673382 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:48.823467 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:48.844806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-409062f9-711a-4b73-afe9-17123f16a9ab tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.203182 Aug 04 21:28:48.845600 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 249/510] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:48 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:49.679246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:49.680140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:49.688980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:49.689386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:49.690018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:49.690976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:49.691820 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:49.692675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:49.867884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:49.869784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:49.878405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:49.879707 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:49.886938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:49.888286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:49.889146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:49.890239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:50.032328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:50.046625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e2323d8d-c1e7-4ca6-9b15-72d9c5506e46 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1681 microversion: 2.1 time: 0.371869 Aug 04 21:28:50.049946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 262/511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:49 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1681 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:50.085909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:50.095477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-019f674d-84af-4e93-a1b9-7e55511b567a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.232770 Aug 04 21:28:50.099356 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 250/512] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:49 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:50.688659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-3b46c64e-36b9-4ea7-92fc-e6ecf957ef8a req-254b7737-1f28-4749-a684-05289bb86afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb24b55d-a68c-42ce-b470-6e1ed385c48a", "name": "network-vif-deleted", "tag": "0c15de0d-bf72-4421-bc97-b7130c21786a"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:50.701610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-3b46c64e-36b9-4ea7-92fc-e6ecf957ef8a req-254b7737-1f28-4749-a684-05289bb86afa service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:50.702087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-3b46c64e-36b9-4ea7-92fc-e6ecf957ef8a req-254b7737-1f28-4749-a684-05289bb86afa service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:50.702512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-3b46c64e-36b9-4ea7-92fc-e6ecf957ef8a req-254b7737-1f28-4749-a684-05289bb86afa service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:50.716532 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-3b46c64e-36b9-4ea7-92fc-e6ecf957ef8a req-254b7737-1f28-4749-a684-05289bb86afa service nova] Creating event network-vif-deleted:0c15de0d-bf72-4421-bc97-b7130c21786a for instance cb24b55d-a68c-42ce-b470-6e1ed385c48a on hv-cinder-85220 Aug 04 21:28:50.747499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-3b46c64e-36b9-4ea7-92fc-e6ecf957ef8a req-254b7737-1f28-4749-a684-05289bb86afa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062412 Aug 04 21:28:50.748865 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 263/513] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:51.069835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:51.070535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:51.078534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:51.089997 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:51.090796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:51.092032 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:51.092737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:51.093388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:51.127540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:51.128903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:51.143670 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:51.148342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:51.148342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:51.148342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:51.148342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:51.149000 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:51.170905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:51.171573 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:51.172326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:51.173047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'fault' on Instance uuid cb24b55d-a68c-42ce-b470-6e1ed385c48a {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:28:51.260546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:51.272668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f279987a-b331-4e14-bf17-177a76de1dfa tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 200 len: 1331 microversion: 2.1 time: 0.204109 Aug 04 21:28:51.273730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 251/514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:51 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 1331 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:51.407828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:51.418165 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0ad859ee-8422-40cf-b764-304fa5612df2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.301667 Aug 04 21:28:51.433502 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 264/515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:51 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:52.304553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:52.305827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:52.314091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:52.314639 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:52.315141 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:52.315970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:52.316756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:52.317246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:52.332472 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a HTTP/1.1 Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:28:52.334208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:28:52.336329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'cb24b55d-a68c-42ce-b470-6e1ed385c48a'} Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:28:52.337065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:28:52.338350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:28:52.339588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:28:52.339588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8bfdca8d-deb0-442d-a822-5817b994ff33 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 404 len: 111 microversion: 2.1 time: 0.035678 Aug 04 21:28:52.339588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 252/516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:52 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:28:52.346228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-200c336e-d277-4368-abaa-ffe41f4df925 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '.version_select at 0x7f8e70f59550>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:52.433836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-200c336e-d277-4368-abaa-ffe41f4df925 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726496862" status: 202 len: 0 microversion: 2.1 time: 0.092269 Aug 04 21:28:52.434558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 265/517] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Aug 4 21:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726496862 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:28:52.440165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:52.441796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:52.448934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:52.453333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:52.453333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:52.453333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:52.453333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:52.453831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:52.732991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:52.744911 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1eccc0c8-d82b-4e19-8f01-a2f75e1c27aa tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.308779 Aug 04 21:28:52.746171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 253/518] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:52 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:53.546391 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a5c91f07-ac08-4293-a73c-04193ca48422 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: .version_select at 0x7f8e70e5c0d0>, body: {"keypair": {"name": "tempest-keypair-1727020016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOelwm7OOAZUwYu+U0s7Z2NeBLuLVlHs7CT2kpwoI5aOXJGhchxHMl7mrZcGpf6gYZNWC4vtCXkYLb5zxHKBy64t0kQdULCLMU7w9sSs+mmV4QvgmEqqdw8BF0iHYLxYKg=="}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:53.563537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-a5c91f07-ac08-4293-a73c-04193ca48422 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:28:53.569831 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-a5c91f07-ac08-4293-a73c-04193ca48422 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:28:53.668239 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a5c91f07-ac08-4293-a73c-04193ca48422 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126640 Aug 04 21:28:53.669157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 266/519] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:28:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:28:53.766772 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:53.767400 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:53.776742 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:53.777232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:53.779415 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:53.780144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:53.784189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:53.789928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:53.961326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:53.976905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fe0e7c90-0a18-45db-8de7-abce136c79dd tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.213832 Aug 04 21:28:53.977641 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 254/520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:53 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:55.013072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:55.013712 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:55.021120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:55.021905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:55.022517 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:55.023522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:55.024299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:55.025164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:55.261479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:55.277474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5895e923-413c-4958-8801-cc4abb5c8fec tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.268849 Aug 04 21:28:55.278441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 267/521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:55 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:56.303551 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:56.304231 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:56.314320 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:56.314884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:56.316332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:56.317966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:56.319003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:56.319961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:56.473401 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1326762225", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f302c59-fa86-42bc-8bff-0f7c4eefd06a"}], "security_groups": [{"name": "tempest-securitygroup--51856693"}], "key_name": "tempest-keypair-1727020016", "user_data": "}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:28:56.483644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:56.494546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-df091118-07b1-4762-b700-e2967120969f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.195349 Aug 04 21:28:56.499545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 255/522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:56 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:28:57.517727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:57.519245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:57.530210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:57.530786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:57.531227 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:57.532167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:57.538539 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:57.538539 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:57.699342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:57.709378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-70abce02-fd43-4c19-a46b-d48c96c2b1f8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.195884 Aug 04 21:28:57.710065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 256/523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:57 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:58.740677 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:58.741515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:58.747654 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:58.748140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:58.748842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:58.749541 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:58.750240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:58.750750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:58.941177 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:28:58.955348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-38175997-574b-4c50-98b9-352b6c78e1de tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.220402 Aug 04 21:28:58.956390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 257/524] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:58 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:28:59.978669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:28:59.980263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:28:59.986896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:59.988205 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:59.988961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:28:59.990258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:28:59.990485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:28:59.990911 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:00.144643 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:00.155264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9b6d68b5-4996-445d-8b17-64cd75a2d8a1 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.180518 Aug 04 21:29:00.156236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 258/525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:28:59 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:00.161923 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:00.162450 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:00.170010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:00.170286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:00.170717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:00.171437 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:00.171957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:00.172405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:00.272115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lazy-loading 'services' on Instance uuid ebc8c40e-8238-4a1b-881e-1c681861109c {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:29:00.734983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7039b56e-97ba-495b-b3cc-fcec40174886 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-volume_attachments/4c21ab5b-a9ba-46f9-b9a2-fdc1bc9c4b64" status: 202 len: 0 microversion: 2.1 time: 0.577293 Aug 04 21:29:00.735801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 259/526] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:29:00 2022] DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-volume_attachments/4c21ab5b-a9ba-46f9-b9a2-fdc1bc9c4b64 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:29:01.178408 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:01.179286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:01.188255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:01.188811 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:01.189427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:01.190278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:01.191191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:01.191893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:01.211749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:01.350443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:01.360028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-625db19a-59fa-482d-9090-5ddf52b5b770 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.187480 Aug 04 21:29:01.360734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 260/527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:01 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:01.809733 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] validate_networks() for [('8f302c59-fa86-42bc-8bff-0f7c4eefd06a', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:29:02.385271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:02.385816 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:02.393340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:02.395335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:02.395822 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:02.396257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:02.396966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:02.397419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:02.397849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:02.545377 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:02.551431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:29:02.555055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-15ac6a03-b475-4766-9441-63d42060eb3f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.173702 Aug 04 21:29:02.555994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 261/528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:02 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:02.556773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:29:02.560924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:29:02.561451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:29:02.561947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:29:02.582079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:02.582834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:02.583880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:02.584860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:02.585539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:02.585989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:02.609656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:29:02.614699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:29:02.637962 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:29:02.637962 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:29:02.802697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d1224d35-74ab-4c00-9018-51332bb34fe3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 6.331874 Aug 04 21:29:02.804216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 268/529] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:28:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 6336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:29:02.816412 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-de99f309-ba29-4b8f-9c15-6bf41bb02473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:02.818208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-de99f309-ba29-4b8f-9c15-6bf41bb02473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:02.918866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-de99f309-ba29-4b8f-9c15-6bf41bb02473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:02.929128 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-de99f309-ba29-4b8f-9c15-6bf41bb02473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1242 microversion: 2.1 time: 0.116425 Aug 04 21:29:02.930041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 262/530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:02 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:02.957642 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-06e8972c-af44-45f4-a350-897cd4030aca tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:02.966288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06e8972c-af44-45f4-a350-897cd4030aca tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:02.966288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06e8972c-af44-45f4-a350-897cd4030aca tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:02.966288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-06e8972c-af44-45f4-a350-897cd4030aca tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:03.032505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-06e8972c-af44-45f4-a350-897cd4030aca tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Going to try to stop instance {{(pid=118549) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 21:29:03.054665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:03.206235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-06e8972c-af44-45f4-a350-897cd4030aca tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action" status: 202 len: 0 microversion: 2.1 time: 0.252091 Aug 04 21:29:03.207168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 269/531] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:29:02 2022] POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:29:03.215516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:03.216127 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:03.223696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:03.224171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:03.224603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:03.225295 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:03.225802 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:03.226252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:03.427243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:03.440052 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8804ac46-af7b-41d3-aea4-8075b703c9c7 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.228133 Aug 04 21:29:03.443195 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 263/532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:03 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:03.585076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:03.586253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:03.595759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:03.596800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:03.598251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:03.600743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:03.601659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:03.602213 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:03.810565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:03.824839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-30d2783a-1c9f-457d-bcbb-50bb0a22995f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.247888 Aug 04 21:29:03.825851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 270/533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:03 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:03.962977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:03.964059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:03.975743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:03.976429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:03.977055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:03.978028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:03.978617 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:03.979249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:04.068148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:04.083192 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b78aa583-615d-417d-9b0e-4b19137092c9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1246 microversion: 2.1 time: 0.128744 Aug 04 21:29:04.084409 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 264/534] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:03 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:04.469853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:04.470538 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:04.477563 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:04.478060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:04.478492 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:04.479211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:04.479697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:04.480312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:04.638747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:04.647161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0d9c5685-4a5f-4f9a-ae0f-22f58ef3e50c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.181278 Aug 04 21:29:04.647773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 271/535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:04 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:04.848086 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:04.849479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:04.857581 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:04.858107 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:04.858563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:04.859266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:04.859746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:04.860167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:05.012698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:05.024213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b8c1077a-2d65-41cd-9585-b4d54ca7b8d0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.180626 Aug 04 21:29:05.029123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 265/536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:04 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:05.107660 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:05.108370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:05.118761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:05.119441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:05.119878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:05.120582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:05.121072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:05.121550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:05.192125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:05.204500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-44ddcfce-bea8-43f6-870d-c27e632eb65a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1294 microversion: 2.1 time: 0.103166 Aug 04 21:29:05.206903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 272/537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:05 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:05.669678 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:05.670361 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:05.677037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:05.677523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:05.677963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:05.678662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:05.679118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:05.679629 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:05.820214 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:05.828815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8c2ecb19-8f39-4e89-9172-f8cde6bc6314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.163237 Aug 04 21:29:05.829483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 266/538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:05 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:06.046443 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:06.047082 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:06.054148 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:06.054654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:06.055084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:06.055793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:06.056243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:06.056665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:06.235594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:06.236222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:06.243056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:06.243575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:06.244019 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:06.248196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:06.248196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:06.248196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:06.279252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:06.287886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d2cb3793-4f99-479b-8230-ac7225baf437 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.245102 Aug 04 21:29:06.288640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 273/539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:06 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:06.398383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:06.406546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fc045616-0aa2-4037-87a5-b0070c3c934b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.178055 Aug 04 21:29:06.407675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 267/540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:06 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:06.850131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:06.850863 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:06.857254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:06.857802 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:06.858320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:06.859063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:06.859603 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:06.860090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:07.118370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:07.125974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-57316fcd-a908-4ae2-8de7-e289eda59e33 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.279875 Aug 04 21:29:07.126612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 274/541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:06 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:07.310792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:07.311567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:07.318751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:07.319239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:07.319702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:07.320433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:07.321004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:07.321430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:07.327811 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-8f11c5a3-4eb4-405d-a74e-78a203ceb55e req-df52b2f2-03cc-452a-b01a-76aa16cb87d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f83e2f-66f7-470f-9782-5d9f3d4227c8", "tag": "4ea314f7-5b91-4b3c-84cc-331f0a7fe38d"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:07.339801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8f11c5a3-4eb4-405d-a74e-78a203ceb55e req-df52b2f2-03cc-452a-b01a-76aa16cb87d2 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:07.340428 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8f11c5a3-4eb4-405d-a74e-78a203ceb55e req-df52b2f2-03cc-452a-b01a-76aa16cb87d2 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:07.340972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8f11c5a3-4eb4-405d-a74e-78a203ceb55e req-df52b2f2-03cc-452a-b01a-76aa16cb87d2 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:07.353854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-8f11c5a3-4eb4-405d-a74e-78a203ceb55e req-df52b2f2-03cc-452a-b01a-76aa16cb87d2 service nova] Creating event network-changed:4ea314f7-5b91-4b3c-84cc-331f0a7fe38d for instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 on hv-cinder-85220 Aug 04 21:29:07.360522 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-8f11c5a3-4eb4-405d-a74e-78a203ceb55e req-df52b2f2-03cc-452a-b01a-76aa16cb87d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037477 Aug 04 21:29:07.361678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 275/542] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:07.430443 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:07.431166 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:07.438409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:07.438939 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:07.440780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:07.441598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:07.442586 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:07.443181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:07.490291 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:07.499125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cbc57b89-f87d-49ef-95d5-aa788851c5e7 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.192671 Aug 04 21:29:07.499741 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 268/543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:07 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:07.698285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:07.708094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9e99027a-a748-4e8e-a946-358edbc18589 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.283160 Aug 04 21:29:07.708901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 276/544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:07 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:08.012535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-995557524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-951782273", "security_groups": [{"name": "tempest-secgroup-smoke-268774528"}], "networks": [{"uuid": "83f826f1-fd59-4e87-ad78-617522607532"}], "block_device_mapping_v2": [{"uuid": "db47204e-09d4-42da-a741-47f1eadc7e5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:08.134532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] validate_networks() for [('83f826f1-fd59-4e87-ad78-617522607532', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:29:08.149538 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:08.150192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:08.157368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.157857 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.158301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.159031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.159595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.160020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.334390 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:08.342959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5c4ba38a-337c-41c7-99ec-e8f2760b7998 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.197233 Aug 04 21:29:08.343760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 277/545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:08 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:08.522699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:08.523665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:08.527196 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:08.531934 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.532553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.533600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.535303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.535952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.536386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.574047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:29:08.574047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:29:08.574047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:29:08.574047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:29:08.574047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:29:08.583744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.584234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.584663 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.585590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.586299 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.588340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.609878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Getting quotas for project f1b4cfcf22614a95ad77db93922449cd. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:29:08.614839 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Getting quotas for user f480dbdc7237420680584ce4866b36e9 and project f1b4cfcf22614a95ad77db93922449cd. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:29:08.686399 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:08.695397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d0899681-75a0-4e55-81d5-d465a1331973 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.177677 Aug 04 21:29:08.696076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 278/546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:08 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:08.729064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:08.729594 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:08.736447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.737004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.737440 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.737556 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:29:08.738190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:08.738650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:08.739075 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:08.741694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db47204e-09d4-42da-a741-47f1eadc7e5b',volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:29:08.873869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:08.881529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6af91f40-81ab-460d-ba8c-c5ed143463ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.156630 Aug 04 21:29:08.882277 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 279/547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:08 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:09.184482 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-08f3420c-f533-45c5-abcc-9fefe18ba761 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.175703 Aug 04 21:29:09.185337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 269/548] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:29:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:29:09.196582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5e16db21-9aa8-4448-aafb-dafcf82fd26a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:09.197450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5e16db21-9aa8-4448-aafb-dafcf82fd26a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:09.266129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5e16db21-9aa8-4448-aafb-dafcf82fd26a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:09.270566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5e16db21-9aa8-4448-aafb-dafcf82fd26a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1087 microversion: 2.1 time: 0.078087 Aug 04 21:29:09.271205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 280/549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:09 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:09.364658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:09.365294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:09.372385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:09.372888 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:09.373329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:09.374093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:09.374734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:09.375176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:09.517263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:09.525424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-155db51f-2009-48c3-ae69-f5da260c0cc8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.164525 Aug 04 21:29:09.525981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 270/550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:09 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:09.719679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:09.720293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:09.737160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:09.737352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:09.737734 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:09.738506 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:09.739120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:09.739520 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:09.877391 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:09.886385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a10ac20b-e9c2-4e7a-ab57-015b26def2bf tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.170775 Aug 04 21:29:09.886963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 281/551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:09 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:09.902940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:09.903668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:09.909832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:09.910412 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:09.910977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:09.911701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:09.912148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:09.912566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:10.114363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:10.121708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-31d035a1-4260-4258-b7eb-9f679e1ee08d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.223528 Aug 04 21:29:10.122290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 271/552] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:09 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:10.291840 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:10.292463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:10.299228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:10.300455 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:10.300885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:10.301578 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:10.302027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:10.302502 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:10.389074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:10.396878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5e579ea7-9bff-4f96-97fc-254b8a8cdce4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1137 microversion: 2.1 time: 0.109201 Aug 04 21:29:10.397357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 282/553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:10 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1137 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:10.547445 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:10.548139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:10.554865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:10.555486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:10.561664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:10.562667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:10.563139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:10.563776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:10.706301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:10.714094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6a1df65c-ebd3-43d0-956f-c83da298c314 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.171141 Aug 04 21:29:10.714663 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 272/554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:10 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:10.914157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:10.915419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:10.925888 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:10.926853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:10.927839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:10.929158 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:10.930060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:10.930846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.086154 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:11.106096 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-48bf4da3-76e9-40aa-9666-31be9f80ee42 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.201118 Aug 04 21:29:11.117899 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 283/555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:10 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:11.142170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:11.144015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:11.150466 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:11.151090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:11.151731 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.152688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:11.153198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:11.153832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.305219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:11.312675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-33871958-a737-443f-9189-ab77dc46c068 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.174402 Aug 04 21:29:11.313254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 273/556] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:11 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:11.418778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:11.419355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:11.426525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:11.427286 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:11.427751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.428470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:11.428996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:11.429405 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.500558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:11.509137 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9201971a-6c11-4b65-a1ff-7093fb448344 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1185 microversion: 2.1 time: 0.094526 Aug 04 21:29:11.509746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 284/557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:11 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:11.736689 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:11.738173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:11.746220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:11.746808 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:11.747562 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.748623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:11.749500 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:11.750648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:11.892252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:11.900688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-18f7a338-f27a-4ba2-93f6-3b059642de89 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.168098 Aug 04 21:29:11.901270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 274/558] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:11 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:12.128638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:12.129574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:12.135990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.136482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.136916 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.137598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.138041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.138460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.334338 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:12.334957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:12.341657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.341842 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:12.342150 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.342626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.343579 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.344405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.345051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.353971 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-46777d33-1a8a-4339-9e0a-54795ef18e43 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.229895 Aug 04 21:29:12.354810 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 285/559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:12 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:12.488337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:12.495927 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c14587e0-71c1-47d6-90c9-655cb9574d49 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.166041 Aug 04 21:29:12.496604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 275/560] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:12 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:12.531073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:12.531719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:12.538937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.539452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.539890 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.540587 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.541040 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.541466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.597747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:12.609844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:12.617640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0bc3ec40-073a-4552-95f0-516fb1a25ced tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1203 microversion: 2.1 time: 0.090272 Aug 04 21:29:12.618216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 286/561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:12 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:12.924157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:12.925418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:12.935082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.935835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.936701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:12.938374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:12.940146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:12.943293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.083725 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:13.097494 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ce817cab-bb7c-462a-97fd-ae97bb00747c tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1679 microversion: 2.1 time: 0.177649 Aug 04 21:29:13.098542 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 276/562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:12 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:13.377468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:13.378646 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:13.386180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.386664 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.387302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.388221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.388678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.389356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.408806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:13.461478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-66d95c08-050a-41d9-9535-c0d3821c6aae req-2930bae3-b5ee-4dbb-b99d-73c7fb572a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f83e2f-66f7-470f-9782-5d9f3d4227c8", "name": "network-vif-plugged", "status": "completed", "tag": "4ea314f7-5b91-4b3c-84cc-331f0a7fe38d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:13.472808 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-66d95c08-050a-41d9-9535-c0d3821c6aae req-2930bae3-b5ee-4dbb-b99d-73c7fb572a75 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.473284 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-66d95c08-050a-41d9-9535-c0d3821c6aae req-2930bae3-b5ee-4dbb-b99d-73c7fb572a75 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.476871 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-66d95c08-050a-41d9-9535-c0d3821c6aae req-2930bae3-b5ee-4dbb-b99d-73c7fb572a75 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.486012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-66d95c08-050a-41d9-9535-c0d3821c6aae req-2930bae3-b5ee-4dbb-b99d-73c7fb572a75 service nova] Creating event network-vif-plugged:4ea314f7-5b91-4b3c-84cc-331f0a7fe38d for instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 on hv-cinder-85220 Aug 04 21:29:13.493216 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-66d95c08-050a-41d9-9535-c0d3821c6aae req-2930bae3-b5ee-4dbb-b99d-73c7fb572a75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035754 Aug 04 21:29:13.494221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 277/563] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:13.516694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:13.517428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:13.524511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.532054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.532592 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.536435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.536435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.536435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.603943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:13.615736 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-79c07311-6f9f-4512-ba96-f6f5d8ab8013 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.242382 Aug 04 21:29:13.616950 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 287/564] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:13 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:13.656286 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:13.657451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:13.667307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.668247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.669411 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.670622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.671339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.671983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.703089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:13.710794 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d3c94ff6-bfc3-482b-bcdf-b190e6e5218e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.198307 Aug 04 21:29:13.716615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 278/565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:13 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:13.813743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-61f17f37-e82d-42a2-a0c4-8167eb635c3c req-b65491a8-1bff-4f1a-8cbf-14e650519abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:13.825411 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-61f17f37-e82d-42a2-a0c4-8167eb635c3c req-b65491a8-1bff-4f1a-8cbf-14e650519abe service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:13.896764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-61f17f37-e82d-42a2-a0c4-8167eb635c3c req-b65491a8-1bff-4f1a-8cbf-14e650519abe service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:13.896764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-61f17f37-e82d-42a2-a0c4-8167eb635c3c req-b65491a8-1bff-4f1a-8cbf-14e650519abe service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:13.896764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-61f17f37-e82d-42a2-a0c4-8167eb635c3c req-b65491a8-1bff-4f1a-8cbf-14e650519abe service nova] Creating event network-changed:6810b4c6-6579-4d40-809f-060dd869530f for instance 0af22041-6737-4c9b-b8c2-896666da1473 on hv-cinder-85220 Aug 04 21:29:13.896764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-61f17f37-e82d-42a2-a0c4-8167eb635c3c req-b65491a8-1bff-4f1a-8cbf-14e650519abe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040684 Aug 04 21:29:13.896764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 279/566] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:29:13.897947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:13.897947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-87e3d1ab-17dd-45cf-9834-ab75b83c1972 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.233830 Aug 04 21:29:13.897947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 288/567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:13 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:14.121722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:14.122448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:14.130312 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.130792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.131219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.132343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.132996 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.133584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.138405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:14.403594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:14.412704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a85ba3a6-cf5e-4a38-a92e-0531761a3c7f tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1656 microversion: 2.1 time: 0.297673 Aug 04 21:29:14.413609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 280/568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:14 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1656 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:14.434083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b720e784-27c7-4507-9dba-564f7d27c4d4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:14.440860 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b720e784-27c7-4507-9dba-564f7d27c4d4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.448267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b720e784-27c7-4507-9dba-564f7d27c4d4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.448267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b720e784-27c7-4507-9dba-564f7d27c4d4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.464902 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b720e784-27c7-4507-9dba-564f7d27c4d4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Going to try to start instance {{(pid=118549) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 21:29:14.638643 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:14.640122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:14.647974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.648806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.649249 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.649958 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.650403 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.650818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.675290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b720e784-27c7-4507-9dba-564f7d27c4d4 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action" status: 202 len: 0 microversion: 2.1 time: 0.244711 Aug 04 21:29:14.676156 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 289/569] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:29:14 2022] POST /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:29:14.686738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:14.687433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:14.696508 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.698011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.698360 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.699077 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.699569 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.699982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.896536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:14.904613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2b53576f-6a5f-42e5-872b-7d4639cf68c6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1665 microversion: 2.1 time: 0.221951 Aug 04 21:29:14.904968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 290/570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:14 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1665 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:14.921068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:14.921068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:14.921068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.921068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.921496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.921496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.921496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.921496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.955701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:14.957739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5109a9b3-1b81-487e-a417-cf608eebda53 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.324296 Aug 04 21:29:14.958325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 281/571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:14 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:14.963252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:14.964138 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:14.970610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.971449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.973144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:14.974135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:14.974594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:14.975016 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:15.065046 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:15.073071 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3290809e-a2fe-41c2-a036-0f47111eb8bb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.167036 Aug 04 21:29:15.073858 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 291/572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:14 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:15.117199 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:15.125232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e5db01ae-f7a5-4cd0-9167-69b1b58b3417 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.165976 Aug 04 21:29:15.125798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 282/573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:14 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:15.925924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:15.926724 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:15.933505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:15.933988 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:15.934427 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:15.935177 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:15.935666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:15.936087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:15.981461 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:15.982080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:15.992600 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:15.993122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:15.993775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:15.994756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:15.995540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:15.995971 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:16.099559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:16.107167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fdcfdca1-4b8d-4229-bed0-f4e0b1c011e5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1665 microversion: 2.1 time: 0.185069 Aug 04 21:29:16.120955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 292/574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:15 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:16.120955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:16.120955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:16.123993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:16.124518 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:16.124954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:16.125654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:16.126107 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:16.126544 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:16.145792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:16.154519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-349a4162-6144-4dab-bc82-984edb7a17ef tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.176911 Aug 04 21:29:16.155179 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 283/575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:15 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:16.160364 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:16.160848 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:16.170139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:16.170616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:16.171132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:16.172216 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:16.172661 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:16.173091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:16.295230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:16.304117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-48095f93-0b1d-4a0c-8dd6-1586f46aceee tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1366 microversion: 2.1 time: 0.195278 Aug 04 21:29:16.304701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 293/576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:16 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:16.446422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:16.455649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-181888ab-dafb-42c5-9423-59a348602699 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.299058 Aug 04 21:29:16.456234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 284/577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:16 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:17.130845 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:17.131409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:17.137944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.138419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.138881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.139590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.140042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.140459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.176044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:17.176638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:17.183781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.184286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.184925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.185631 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.186084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.187696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.279061 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:17.286831 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-69312db9-df4e-46fe-93b2-32e8e7706eea tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1665 microversion: 2.1 time: 0.159910 Aug 04 21:29:17.287458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 294/578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:17 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:17.325244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:17.325799 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:17.326421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:17.333679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.334151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.334574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.335255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.335651 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-56e0ebd5-82d0-4c42-9d97-6f7b7dc0e8e9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.163364 Aug 04 21:29:17.335881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.336303 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.336423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 285/579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:17 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:17.472874 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:17.476424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:17.477038 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:17.481312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8855aa51-c021-49f3-8b9f-3ad9d87f41eb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1555 microversion: 2.1 time: 0.159207 Aug 04 21:29:17.482061 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 295/580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:17 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:17.486723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.487150 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.487718 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.499257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.499257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.499257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.506401 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:17.506893 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:17.512959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.513447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.513880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.514575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:17.515034 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:17.515484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:17.607645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7c38deda-18a0-4dbd-b2ce-6f3e9658996d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105384 Aug 04 21:29:17.608249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 296/581] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:29:17 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:29:17.634676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:17.642408 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-29207ebb-1412-4630-b68f-17b798124020 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.170041 Aug 04 21:29:17.648803 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 286/582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:17 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:18.308718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:18.309323 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:18.315451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.315964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.316380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.317351 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.317805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.318229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.356985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:18.358394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:18.364754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.365230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.365658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.366345 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.366795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.367213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.506815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:18.514981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-68f8aa9e-a6bd-4b02-97a2-6f6c68a3962c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.161833 Aug 04 21:29:18.517588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 287/583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:18 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:18.546275 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:18.554247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-5a803305-69e0-4279-ab60-4a4a7610929e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1669 microversion: 2.1 time: 0.249860 Aug 04 21:29:18.554827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 297/584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:18 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1669 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:18.662863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:18.663626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:18.665545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:18.666309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=8 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:18.671093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.671615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.672122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.672797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.673425 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.673854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.729419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-704b6746-3595-4a29-a9c4-a90f52de8634 req-1291e8e8-f0d0-4fe5-a7cb-987896c6a010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f83e2f-66f7-470f-9782-5d9f3d4227c8", "tag": "4ea314f7-5b91-4b3c-84cc-331f0a7fe38d"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:18.739953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-704b6746-3595-4a29-a9c4-a90f52de8634 req-1291e8e8-f0d0-4fe5-a7cb-987896c6a010 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:18.741598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-704b6746-3595-4a29-a9c4-a90f52de8634 req-1291e8e8-f0d0-4fe5-a7cb-987896c6a010 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:18.742021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-704b6746-3595-4a29-a9c4-a90f52de8634 req-1291e8e8-f0d0-4fe5-a7cb-987896c6a010 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:18.753914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-704b6746-3595-4a29-a9c4-a90f52de8634 req-1291e8e8-f0d0-4fe5-a7cb-987896c6a010 service nova] Creating event network-changed:4ea314f7-5b91-4b3c-84cc-331f0a7fe38d for instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 on hv-cinder-85220 Aug 04 21:29:18.759012 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-704b6746-3595-4a29-a9c4-a90f52de8634 req-1291e8e8-f0d0-4fe5-a7cb-987896c6a010 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033189 Aug 04 21:29:18.759986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 298/585] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:18.849126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:18.858590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4b73ec6e-adaa-4931-ad2d-83e7c39fffa6 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.200269 Aug 04 21:29:18.859480 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 288/586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:18 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:19.537068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:19.541204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:19.541204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=12 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:19.545356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:19.545836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:19.546269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:19.546961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:19.547569 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:19.547994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:19.686059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:19.695167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-64392c42-1be0-4cff-b13d-ec21bae4614d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.162410 Aug 04 21:29:19.695778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 299/587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:19 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:19.879863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:19.880508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:19.887670 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:19.888365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:19.888798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:19.889496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:19.889941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:19.890354 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:20.027275 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:20.035061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-66caf6ad-2ea0-4c48-87fb-2e5718969b3d tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.160106 Aug 04 21:29:20.035792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 289/588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:19 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:20.717223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:20.717824 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:20.724325 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:20.724800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:20.725284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:20.726014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:20.726459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:20.726875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:20.863595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:20.871613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-78647125-2322-4a5a-baeb-fb4bc7e64796 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.158216 Aug 04 21:29:20.872186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 300/589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:20 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:21.060030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:21.060599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:21.067459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:21.067940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:21.068368 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:21.069172 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:21.069518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:21.069935 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:21.207266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:21.214931 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b45b2529-1d32-4e2b-90ed-4b8968b90bbb tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.158865 Aug 04 21:29:21.215537 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 290/590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:21 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:21.895145 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:21.895775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:21.902500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:21.902975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:21.903429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:21.904114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:21.904617 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:21.905036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:22.038717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:22.047167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-215a799e-786d-424a-a816-cd871005a03d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.156456 Aug 04 21:29:22.047768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 301/591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:21 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:22.237030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:22.237638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:22.244285 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:22.244765 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:22.245196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:22.245899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:22.246342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:22.246760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:22.378531 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:22.386229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e7be9fcc-b7d8-489c-8f16-097eca6bebf7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.152978 Aug 04 21:29:22.386801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 291/592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:22 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:23.069171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:23.069778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:23.076323 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:23.076802 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:23.077235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:23.077922 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:23.078377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:23.078803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:23.224650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:23.233267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-bb1ad8aa-e3ce-4124-8e0a-d140913a9907 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.168720 Aug 04 21:29:23.233851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 302/593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:23 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:23.406047 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:23.411139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:23.413935 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:23.414409 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:23.414837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:23.415705 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:23.416151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:23.416567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:23.792751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:23.801317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8ac71b3b-e68b-4d91-b3ab-e82d3f69651e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.399082 Aug 04 21:29:23.801889 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 292/594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:23 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:24.254686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:24.255294 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:24.261840 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:24.262320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:24.262756 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:24.263470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:24.263929 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:24.264353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:24.394950 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:24.403060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7799808b-e46e-47f7-8dc5-b46f5d00f491 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.152308 Aug 04 21:29:24.403676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 303/595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:24 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:24.822714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:24.823352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:24.830182 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:24.830665 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:24.831142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:24.831883 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:24.833017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:24.833443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:24.966554 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:24.974266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fab6ec33-ed23-4d47-b60d-543584ac9e0f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.155397 Aug 04 21:29:24.974837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 293/596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:24 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:25.329597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-b87131f8-294f-4e8c-ac04-e14bfc11200c req-2868014c-980c-4c98-9af9-1b7aff4d008b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "name": "network-vif-plugged", "status": "completed", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:25.339831 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-b87131f8-294f-4e8c-ac04-e14bfc11200c req-2868014c-980c-4c98-9af9-1b7aff4d008b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:25.340345 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-b87131f8-294f-4e8c-ac04-e14bfc11200c req-2868014c-980c-4c98-9af9-1b7aff4d008b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:25.340772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-b87131f8-294f-4e8c-ac04-e14bfc11200c req-2868014c-980c-4c98-9af9-1b7aff4d008b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:25.344632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:25.352047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-b87131f8-294f-4e8c-ac04-e14bfc11200c req-2868014c-980c-4c98-9af9-1b7aff4d008b service nova] Creating event network-vif-plugged:6810b4c6-6579-4d40-809f-060dd869530f for instance 0af22041-6737-4c9b-b8c2-896666da1473 on hv-cinder-85220 Aug 04 21:29:25.356944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-b87131f8-294f-4e8c-ac04-e14bfc11200c req-2868014c-980c-4c98-9af9-1b7aff4d008b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031213 Aug 04 21:29:25.357532 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 304/597] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:25.424190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:25.425267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:25.431783 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:25.432270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:25.432711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:25.433545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:25.434002 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:25.434426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:25.576057 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:25.583961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-bb31a189-663d-4672-8046-ba2482b89a7c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.163800 Aug 04 21:29:25.584519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 294/598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:25 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:25.994572 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:25.995430 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:26.002130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:26.002634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:26.003063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:26.003783 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:26.004250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:26.004663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:26.140014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:26.148062 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-51ce3264-9abe-46e8-8be2-035f426378d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.157812 Aug 04 21:29:26.148656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 305/599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:25 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:26.605599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:26.606233 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:26.612655 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:26.613119 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:26.613547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:26.614221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:26.614665 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:26.615084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:26.745281 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:26.753173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9814fbcf-b527-445f-9676-81db689de8b3 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.151558 Aug 04 21:29:26.753736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 295/600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:26 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:27.169118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:27.169920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:27.176501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:27.176976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:27.177404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:27.178079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:27.178757 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:27.179333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:27.313624 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:27.323231 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cbf45b4d-7893-4ac2-8df4-1656d9754125 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1258 microversion: 2.1 time: 0.157837 Aug 04 21:29:27.324259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 306/601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:27 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:27.774036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:27.774765 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:27.781229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:27.781714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:27.782246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:27.782970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:27.783460 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:27.784389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:27.922193 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:27.926229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=100 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:27.930944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5e325e15-6fa2-46ed-9f50-e51cef682e72 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.160853 Aug 04 21:29:27.931534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 296/602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:27 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:28.345444 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:28.346162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:28.353529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.354014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.354445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.355141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.355620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.356041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.490748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:28.498354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ee9084af-b6f9-46f2-b424-6f3e976c9441 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1442 microversion: 2.1 time: 0.156763 Aug 04 21:29:28.498926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 307/603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:28 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:28.519223 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:28.523697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:28.525916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.526388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.526814 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.527526 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.527974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.528407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.584523 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:28.584989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:28.590905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.591465 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.591891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.592568 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.593010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.593424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.625050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3f22f685-4a1b-4ef4-be3d-237633b2d334 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments/fdb0c04b-619c-4d0d-b02c-c588daa84ce4" status: 200 len: 194 microversion: 2.20 time: 0.045022 Aug 04 21:29:28.625652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 308/604] 10.222.0.25 () {60 vars in 1454 bytes} [Thu Aug 4 21:29:28 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments/fdb0c04b-619c-4d0d-b02c-c588daa84ce4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:29:28.661931 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:28.669766 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-68f93704-0c27-422e-9338-812a3dbca6f4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1442 microversion: 2.1 time: 0.155176 Aug 04 21:29:28.670344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 297/605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:28 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:28.696379 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:28.696945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:28.702951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.703465 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.703898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.704583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.705035 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.705455 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.830531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lazy-loading 'services' on Instance uuid 28509a51-71ec-4aab-a7c1-bfb56ed3a676 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:29:28.952091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:28.952699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:28.970505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.970505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.970505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:28.970505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:28.973097 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:28.973097 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:29.082805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1b8a481a-8770-4865-8cd9-c6741f7ae910 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments/fdb0c04b-619c-4d0d-b02c-c588daa84ce4" status: 202 len: 0 microversion: 2.20 time: 0.390565 Aug 04 21:29:29.083914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 309/606] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Aug 4 21:29:28 2022] DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments/fdb0c04b-619c-4d0d-b02c-c588daa84ce4 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:29:29.103469 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:29.106203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:29.110263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:29.113977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:29.114825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:29.115542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:29.115927 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:29.116448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:29.117048 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:29.120327 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1fa0b2e3-78e9-43aa-aaf9-e2b235c3964f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.172039 Aug 04 21:29:29.120950 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 298/607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:28 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:29.148757 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-49cb76e4-a94c-41cb-a967-2bd96875cacb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060573 Aug 04 21:29:29.149439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 310/608] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Aug 4 21:29:29 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:29:30.142576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:30.143141 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:30.150007 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:30.150577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:30.151087 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:30.151828 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:30.152282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:30.152704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:30.162357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:30.165657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:30.172325 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:30.172839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:30.173370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:30.174185 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:30.175435 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:30.175900 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:30.207549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-51b2ddd0-95fd-464a-9b18-89dfc846a246 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050078 Aug 04 21:29:30.208134 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 311/609] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Aug 4 21:29:30 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:29:30.303401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:30.314801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3496eec0-a54a-4c37-93e7-292f178fa23a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.176426 Aug 04 21:29:30.327572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 299/610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:30 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:31.109267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-d5fc7d51-4a1e-4db4-a173-552ca43e1770 req-28df2f15-1cbf-4631-9028-e3ab4dc12a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:31.119754 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-d5fc7d51-4a1e-4db4-a173-552ca43e1770 req-28df2f15-1cbf-4631-9028-e3ab4dc12a18 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.120256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-d5fc7d51-4a1e-4db4-a173-552ca43e1770 req-28df2f15-1cbf-4631-9028-e3ab4dc12a18 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.120750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-d5fc7d51-4a1e-4db4-a173-552ca43e1770 req-28df2f15-1cbf-4631-9028-e3ab4dc12a18 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.135221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-d5fc7d51-4a1e-4db4-a173-552ca43e1770 req-28df2f15-1cbf-4631-9028-e3ab4dc12a18 service nova] Creating event network-changed:6810b4c6-6579-4d40-809f-060dd869530f for instance 0af22041-6737-4c9b-b8c2-896666da1473 on hv-cinder-85220 Aug 04 21:29:31.140375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-d5fc7d51-4a1e-4db4-a173-552ca43e1770 req-28df2f15-1cbf-4631-9028-e3ab4dc12a18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034781 Aug 04 21:29:31.141211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 312/611] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:31.220471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:31.224106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:31.231695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.232509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.233154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.234125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.234458 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.234952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.267877 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fab7ff0f-8390-4a15-bc75-0d6ae14eced2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051675 Aug 04 21:29:31.269086 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 300/612] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Aug 4 21:29:31 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:31.338835 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:31.339941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:31.341314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:31.342004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:31.347657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.348441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.349094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.349426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.350112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.350525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.350696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.351299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.351690 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.352149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.352561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.352675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.381383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:29:31.514742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:31.526259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-84e55925-9070-4bf3-a5b1-2ac5914d04a8 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.191701 Aug 04 21:29:31.526851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 313/613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:31 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:29:31.629585 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:31.740700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5f774448-6a97-44c5-b957-895d9b06caf2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 204 len: 0 microversion: 2.20 time: 0.403176 Aug 04 21:29:31.741907 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 301/614] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Aug 4 21:29:31 2022] DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 21:29:31.749782 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:31.750391 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:31.757294 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.757776 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.758205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.758891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:31.759358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:31.759780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:31.895870 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:31.904393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:31.905804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:31.907041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cdb61659-fd5c-476d-b3d1-e6b18a3419d9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.161229 Aug 04 21:29:31.907893 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 314/615] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:31 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:32.548864 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:32.550272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:32.556923 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:32.557408 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:32.557844 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:32.558538 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:32.558990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:32.559435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:32.694675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:32.702728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3412a08c-6796-4ab7-ad29-543c29643f95 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.158174 Aug 04 21:29:32.703294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 302/616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:32 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:32.930720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:32.931341 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:32.938082 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:32.938892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:32.939336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:32.940123 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:32.941087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:32.941511 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:33.083110 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:33.091279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:33.092806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:33.093951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-97e4a29f-58a7-44b4-b658-8a80d4ac00c1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.167154 Aug 04 21:29:33.094510 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 315/617] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:32 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:33.724965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:33.725837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:33.732034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:33.732740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:33.733174 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:33.733869 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:33.734317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:33.734736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:33.865175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:33.873233 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c9c13011-f290-4906-aa47-879607be8e5d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.152295 Aug 04 21:29:33.873799 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 303/618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:33 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:34.118718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:34.119245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:34.125853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:34.126327 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:34.126753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:34.128186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:34.128628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:34.129043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:34.264141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:34.272717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:34.274207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:34.275384 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6c1f5cbd-4e6a-4ba7-a1a7-faff7c45c06f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1725 microversion: 2.20 time: 0.161268 Aug 04 21:29:34.275945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 316/619] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:34 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:34.895379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:34.895930 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:34.903407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:34.903895 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:34.904334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:34.905028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:34.905489 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:34.905913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:35.104717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:35.113236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-837909eb-e9b3-4b14-b08f-5742bb12f38d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.221924 Aug 04 21:29:35.113835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 304/620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:34 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:35.301317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:35.301956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:35.309872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:35.310275 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:35.310709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:35.311450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:35.311905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:35.312322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:35.376425 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:35.384765 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:35.386361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:35.387619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cb12d5d2-d811-4833-b78d-f47c04021620 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1657 microversion: 2.20 time: 0.090764 Aug 04 21:29:35.388163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 317/621] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:35 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1657 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:35.521026 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-dcd36f57-7ae1-4b26-b786-de0ce17e6656 req-6e3912c1-e35d-4d8e-88f2-bf1ceced7a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28509a51-71ec-4aab-a7c1-bfb56ed3a676", "name": "network-vif-deleted", "tag": "f68690c1-b85b-48e2-bf7c-c1957b7fc070"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:35.530909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-dcd36f57-7ae1-4b26-b786-de0ce17e6656 req-6e3912c1-e35d-4d8e-88f2-bf1ceced7a76 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:35.531399 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-dcd36f57-7ae1-4b26-b786-de0ce17e6656 req-6e3912c1-e35d-4d8e-88f2-bf1ceced7a76 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:35.531823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-dcd36f57-7ae1-4b26-b786-de0ce17e6656 req-6e3912c1-e35d-4d8e-88f2-bf1ceced7a76 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:35.544268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-dcd36f57-7ae1-4b26-b786-de0ce17e6656 req-6e3912c1-e35d-4d8e-88f2-bf1ceced7a76 service nova] Creating event network-vif-deleted:f68690c1-b85b-48e2-bf7c-c1957b7fc070 for instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 on hv-cinder-85220 Aug 04 21:29:35.550343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-dcd36f57-7ae1-4b26-b786-de0ce17e6656 req-6e3912c1-e35d-4d8e-88f2-bf1ceced7a76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032849 Aug 04 21:29:35.553581 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 305/622] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:36.134678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:36.135304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:36.141719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:36.142202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:36.142629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:36.143952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:36.144402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:36.144818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:36.285580 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:36.294644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f2a837e9-fc93-495f-9609-0dfbc1c52b10 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1736 microversion: 2.1 time: 0.163776 Aug 04 21:29:36.295481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 318/623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:36 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:36.410919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:36.411699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:36.418917 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:36.419458 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:36.419892 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:36.420583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:36.421027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:36.421441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:36.454768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:36.455245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:36.455733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:36.456178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lazy-loading 'fault' on Instance uuid 28509a51-71ec-4aab-a7c1-bfb56ed3a676 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:29:36.501102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:36.510404 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:36.511973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:36.513109 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e64908a7-9a6c-45db-a320-a5ae4c566934 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 200 len: 1371 microversion: 2.20 time: 0.106708 Aug 04 21:29:36.513701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 306/624] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:36 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:37.315872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:37.316474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:37.323218 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.323719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.324142 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.324815 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.325257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.325669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.460492 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:37.469632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2683c4bb-712d-4490-afb4-b8e106e4df26 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1716 microversion: 2.1 time: 0.157860 Aug 04 21:29:37.470213 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 319/625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:37 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:37.544792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:37.545393 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:37.551783 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.552262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.555567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.555567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.555567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.555567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.568371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] HTTP exception thrown: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Request method failure captured: Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 HTTP/1.1 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk9DSvJsQP5iMAxn11aV3P4XZG7Y-4Rz32UQF0i9_h0YkqkzQ1FYQiAX08UqOydYU8h5pvzpRbFp7UrqzhQvpTMv2yWV6R8iJ2qcapXVf6g_XRh_9eWm12Zqiisc1eM05eEdUipeT5O1Pi4iIaHc5QLRvvfAUP8bVL5zMG0q50QaSY Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:29:37.570301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 4087b29e666c4afaa36118e82eb169d3 Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:29:37.573430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '28509a51-71ec-4aab-a7c1-bfb56ed3a676'} Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:29:37.574534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:29:37.576043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.577335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Returning 404 to user: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:29:37.577335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6fef96e4-37a4-4f2a-99ea-a54134b905d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 404 len: 111 microversion: 2.20 time: 0.030834 Aug 04 21:29:37.577335 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 307/626] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:37 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:29:37.581394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:37.581934 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:37.582849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-bb094c4e-b204-4895-81f9-fff461d579ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '.version_select at 0x7f8e70ec0790>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:37.588207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.588693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.589126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.589820 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.590270 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.590688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.671803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] HTTP exception thrown: Cannot 'detach_volume' instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 while it is in vm_state rescued Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Request method failure captured: Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments/98a81a58-5029-4df8-9f6e-1e07000e2cac HTTP/1.1 Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk60dmJwv_DBHx-KVKMsfB6ewGKd9IIjuZmlw4lUiv3rZOeSMbMO7Eqdgejm3iM__A7OHbVi6-MlaNnC8DSqhoPyvYQP46rQ3zd_4srmtPoFstteE053HP8N4yYA9rEUApWIZizVzZbEILj6HgVo4Y_DPM6Gmez2NM21RNDWH73pOE Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:29:37.673439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 3d5f53509b2f42269cd26e77c79ad8be Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:29:37.676278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Cannot 'detach_volume' instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 while it is in vm_state rescued Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'server_id': 'fbf22c7f-6277-4d8e-b3f2-fae569fdcb65', 'id': '98a81a58-5029-4df8-9f6e-1e07000e2cac'} Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:29:37.677076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 while it is in vm_state rescued Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 while it is in vm_state rescued Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:29:37.678496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Returning 409 to user: Cannot 'detach_volume' instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 while it is in vm_state rescued {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:29:37.679647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-fe1849fc-009e-4375-ae0c-ffdd2ebc310a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments/98a81a58-5029-4df8-9f6e-1e07000e2cac" status: 409 len: 152 microversion: 2.1 time: 0.098833 Aug 04 21:29:37.679647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 320/627] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:29:37 2022] DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments/98a81a58-5029-4df8-9f6e-1e07000e2cac => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 21:29:37.684375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:37.685002 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:37.690746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.691259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.691715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.692652 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.693091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.693505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.710477 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:37.746966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-bb094c4e-b204-4895-81f9-fff461d579ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650827798" status: 204 len: 0 microversion: 2.20 time: 0.168293 Aug 04 21:29:37.747584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 308/628] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Aug 4 21:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650827798 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:29:37.915270 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d8e0adf6-8a5a-4949-b358-a591e3ef52d6 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "POST /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/action" status: 202 len: 0 microversion: 2.1 time: 0.234398 Aug 04 21:29:37.915978 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 321/629] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:29:37 2022] POST /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:29:37.924793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:37.925561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:37.932810 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.933355 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.933915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:37.934610 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:37.935058 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:37.935540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:38.123153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:38.132685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d9058181-847c-4688-9356-0e995daffc06 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1724 microversion: 2.1 time: 0.212382 Aug 04 21:29:38.133310 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 309/630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:37 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:38.585725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-09afa19e-cd61-42d5-8a9a-03b771ea9c99 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'create', calling method: .version_select at 0x7f8e70d55550>, body: {"keypair": {"name": "tempest-keypair-1111205064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2a3CX0p28zqHFImdJdAnPqx/uCKYPUj/xpiLx3hv2NLwIOaChqu1B5EeiNOz1Xt6z4SxyYKHp7rkV7cKo36+xXsQpafOHd20ZXK9H1Zdzc+L3lLvfMDvxGuRU6BQjCCg=="}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:38.604534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-09afa19e-cd61-42d5-8a9a-03b771ea9c99 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:29:38.608674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-09afa19e-cd61-42d5-8a9a-03b771ea9c99 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for user 4087b29e666c4afaa36118e82eb169d3 and project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:29:38.623375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:38.690913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-09afa19e-cd61-42d5-8a9a-03b771ea9c99 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.110609 Aug 04 21:29:38.691543 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 322/631] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Aug 4 21:29:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 21:29:39.153966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:39.154891 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:39.161262 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:39.161738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:39.162167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:39.162933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:39.163420 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:39.164280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:39.333933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:39.333933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1be6a10f-99ba-4054-a822-0da6f4117822 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1724 microversion: 2.1 time: 0.181226 Aug 04 21:29:39.333933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 310/632] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:39 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:40.354518 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:40.355279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:40.361958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:40.362445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:40.362884 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:40.363614 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:40.364070 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:40.364489 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:40.509808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:40.519231 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b04bef9a-b02f-460e-b60c-0ad5b0c7f33c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1724 microversion: 2.1 time: 0.169509 Aug 04 21:29:40.520065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 323/633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:40 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:40.961236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-569056411", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49e52138-105f-4d18-a85f-2cbb22c5c910"}], "security_groups": [{"name": "tempest-securitygroup--873653132"}], "key_name": "tempest-keypair-1111205064", "user_data": "}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:41.080235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] validate_networks() for [('49e52138-105f-4d18-a85f-2cbb22c5c910', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:29:41.489317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:29:41.489732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:29:41.490501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:29:41.490772 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:29:41.491182 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:29:41.500983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:41.502183 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:41.502183 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:41.502593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:41.504272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:41.504272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:41.532938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:29:41.538143 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Getting quotas for user 4087b29e666c4afaa36118e82eb169d3 and project 48234ebc0b1341719ebf2a9419cb6b54. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:29:41.543975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:41.544583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:41.550830 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:29:41.551785 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:41.552290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:41.552708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:41.553258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:29:41.553414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:41.553840 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:41.554260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:41.702567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:41.711170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e99f488b-6452-4547-8948-e7525707293f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1730 microversion: 2.1 time: 0.171916 Aug 04 21:29:41.711984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 324/634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:29:41 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:29:41.727739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0951f8a9-e845-47f5-919a-200257fe1549 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.770620 Aug 04 21:29:41.735051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 311/635] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Aug 4 21:29:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 21:29:41.735278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:41.735278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:41.740784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:41.741146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:41.741651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:41.742448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:41.742976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:41.743549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:41.744913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-88dfb6dd-395c-4b90-98a3-4a3e8eaa0dba tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:41.745587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-88dfb6dd-395c-4b90-98a3-4a3e8eaa0dba tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:41.802561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-88dfb6dd-395c-4b90-98a3-4a3e8eaa0dba tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:41.810803 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-88dfb6dd-395c-4b90-98a3-4a3e8eaa0dba tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:41.812336 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-88dfb6dd-395c-4b90-98a3-4a3e8eaa0dba tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:41.813449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-88dfb6dd-395c-4b90-98a3-4a3e8eaa0dba tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1281 microversion: 2.20 time: 0.073528 Aug 04 21:29:41.814003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 312/636] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:41 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:29:41.831616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7a16ae06-88b3-4d77-aa9d-2e0d7380621f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102111 Aug 04 21:29:41.839292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 325/637] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:29:41 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:29:42.842362 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:42.843771 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:42.853329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:42.854547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:42.855166 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:42.856487 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:42.857069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:42.857552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:42.885399 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-48cbe06a-38b5-4471-9066-5c8b8ad42dde req-c9424664-cff6-4b8f-87bf-f530e690a64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf22c7f-6277-4d8e-b3f2-fae569fdcb65", "tag": "ed85d1f1-7378-435e-90bf-f89e3fc4e6dc"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:42.906894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-48cbe06a-38b5-4471-9066-5c8b8ad42dde req-c9424664-cff6-4b8f-87bf-f530e690a64e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:42.907549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-48cbe06a-38b5-4471-9066-5c8b8ad42dde req-c9424664-cff6-4b8f-87bf-f530e690a64e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:42.907826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-48cbe06a-38b5-4471-9066-5c8b8ad42dde req-c9424664-cff6-4b8f-87bf-f530e690a64e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:42.930458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-48cbe06a-38b5-4471-9066-5c8b8ad42dde req-c9424664-cff6-4b8f-87bf-f530e690a64e service nova] Creating event network-changed:ed85d1f1-7378-435e-90bf-f89e3fc4e6dc for instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 on hv-cinder-85220 Aug 04 21:29:42.936025 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-48cbe06a-38b5-4471-9066-5c8b8ad42dde req-c9424664-cff6-4b8f-87bf-f530e690a64e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055887 Aug 04 21:29:42.936797 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 326/638] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:29:42.936963 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:42.949128 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:42.951174 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:42.952378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4c55fab7-a41d-4899-9603-c312c7833f61 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1285 microversion: 2.20 time: 0.114114 Aug 04 21:29:42.953481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 313/639] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:42 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:43.985847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:43.987334 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:43.993917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:43.994478 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:43.995113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:43.995839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:43.996450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:43.996872 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:44.066544 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:44.075292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:44.076827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:44.077966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-41e3922f-e83f-49c0-b38a-786f0ef1e3c2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1333 microversion: 2.20 time: 0.097134 Aug 04 21:29:44.078716 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 327/640] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:43 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:44.953084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-a51acc18-88b0-476d-829b-869de8cd7eb4 req-15689e81-187c-40fa-9cb6-f76621251217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf22c7f-6277-4d8e-b3f2-fae569fdcb65", "tag": "ed85d1f1-7378-435e-90bf-f89e3fc4e6dc"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:44.964084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a51acc18-88b0-476d-829b-869de8cd7eb4 req-15689e81-187c-40fa-9cb6-f76621251217 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:44.969529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a51acc18-88b0-476d-829b-869de8cd7eb4 req-15689e81-187c-40fa-9cb6-f76621251217 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:44.969529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a51acc18-88b0-476d-829b-869de8cd7eb4 req-15689e81-187c-40fa-9cb6-f76621251217 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:44.976268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-a51acc18-88b0-476d-829b-869de8cd7eb4 req-15689e81-187c-40fa-9cb6-f76621251217 service nova] Creating event network-changed:ed85d1f1-7378-435e-90bf-f89e3fc4e6dc for instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 on hv-cinder-85220 Aug 04 21:29:44.981363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-a51acc18-88b0-476d-829b-869de8cd7eb4 req-15689e81-187c-40fa-9cb6-f76621251217 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Aug 04 21:29:44.981970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 314/641] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:45.102256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:45.102869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:45.110615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:45.111103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:45.111602 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:45.112285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:45.112749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:45.113170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:45.366420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:45.377935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:45.390302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:45.390302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9a8f39cf-98e1-4642-ae3d-ff2fd87b6810 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.282433 Aug 04 21:29:45.390302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 328/642] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:45 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:29:46.248137 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-fe275fea-20b0-4829-8b26-8c8876e12631 req-8b5c4406-5736-471a-8489-8360545b59a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:46.258238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-fe275fea-20b0-4829-8b26-8c8876e12631 req-8b5c4406-5736-471a-8489-8360545b59a4 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:46.258711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-fe275fea-20b0-4829-8b26-8c8876e12631 req-8b5c4406-5736-471a-8489-8360545b59a4 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:46.264748 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-fe275fea-20b0-4829-8b26-8c8876e12631 req-8b5c4406-5736-471a-8489-8360545b59a4 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:46.270349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-fe275fea-20b0-4829-8b26-8c8876e12631 req-8b5c4406-5736-471a-8489-8360545b59a4 service nova] Creating event network-changed:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:29:46.274826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-fe275fea-20b0-4829-8b26-8c8876e12631 req-8b5c4406-5736-471a-8489-8360545b59a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Aug 04 21:29:46.275500 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 315/643] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:46.403607 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:46.404203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:46.411600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:46.412588 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:46.413147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:46.413838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:46.414314 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:46.414803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:46.558930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:46.567790 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:46.569353 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:46.570464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c48f822f-e3a5-4e0f-bbd2-74f7069bfce3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.170810 Aug 04 21:29:46.571026 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 329/644] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:46 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:47.594577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:47.595291 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:47.602095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:47.602577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:47.603002 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:47.617770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:47.618265 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:47.618697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:47.759247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:47.762792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:47.767775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:47.769860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:47.770928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5f91614c-01b2-452a-825f-6038a9bc3079 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.181235 Aug 04 21:29:47.771519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 316/645] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:47 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:48.795016 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:48.795628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:48.798158 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=4 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:48.803628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:48.804103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:48.804530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:48.805216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:48.805665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:48.806086 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:48.948491 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:48.956494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:48.957980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:48.959476 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-257b2b60-fb9d-4158-a81d-4b87731d2f76 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.168425 Aug 04 21:29:48.960033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 330/646] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:48 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:49.982454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:49.983052 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:49.990477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:49.990960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:49.991418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:49.992123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:49.992593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:49.993046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:50.123969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:50.132403 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:50.133878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:50.134960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f08d38c9-98ef-4507-8cf9-87bb20a47d6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.156808 Aug 04 21:29:50.135559 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 317/647] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:49 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:51.157257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:51.157857 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:51.164333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:51.164806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:51.165230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:51.165946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:51.166387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:51.166798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:51.320243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:51.324995 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:51.326645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:51.327764 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-17cec7d3-e303-4ea2-883c-ed66c62462eb tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.174472 Aug 04 21:29:51.328321 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 331/648] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:51 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:51.485804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-8ed3d976-26b4-4486-9359-c9df74981c29 req-bfc5da73-a4b8-41c4-9d34-c57ec14adf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "name": "network-vif-plugged", "status": "completed", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:51.496081 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8ed3d976-26b4-4486-9359-c9df74981c29 req-bfc5da73-a4b8-41c4-9d34-c57ec14adf4d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:51.496552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8ed3d976-26b4-4486-9359-c9df74981c29 req-bfc5da73-a4b8-41c4-9d34-c57ec14adf4d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:51.496977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8ed3d976-26b4-4486-9359-c9df74981c29 req-bfc5da73-a4b8-41c4-9d34-c57ec14adf4d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:51.508391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-8ed3d976-26b4-4486-9359-c9df74981c29 req-bfc5da73-a4b8-41c4-9d34-c57ec14adf4d service nova] Creating event network-vif-plugged:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:29:51.511763 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:51.513531 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-8ed3d976-26b4-4486-9359-c9df74981c29 req-bfc5da73-a4b8-41c4-9d34-c57ec14adf4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031486 Aug 04 21:29:51.514101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 318/649] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:29:52.352019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:52.352622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:52.359483 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:52.359961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:52.360389 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:52.361072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:52.361515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:52.361929 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:52.496403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:52.506091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:52.510707 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:52.510707 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-108b97ca-9414-4f46-aab0-dae5e204fb0d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1406 microversion: 2.20 time: 0.160758 Aug 04 21:29:52.510707 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 332/650] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:52 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:53.530145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=8 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:53.535889 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:53.536609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:53.542824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:53.543300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:53.543789 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:53.544485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:53.544936 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:53.545360 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:53.703687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:53.712870 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:53.714382 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:29:53.716296 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4bf87d01-46a3-4eda-b505-15e6fb51ec2b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1598 microversion: 2.20 time: 0.186961 Aug 04 21:29:53.717226 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 319/651] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:29:53 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1598 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:29:53.740749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:29:53.741291 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:29:53.749075 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:53.750426 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:53.750866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:53.751606 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:53.752058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:53.758602 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:53.834646 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-480eaf1e-250e-4c76-83be-ce5b868914e2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098266 Aug 04 21:29:53.835460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 333/652] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Aug 4 21:29:53 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:29:55.092220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-6c58931a-02e8-457a-a413-8d081c8c1af4 req-da699c7e-a430-4241-83c2-4408087905d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:29:55.102700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-6c58931a-02e8-457a-a413-8d081c8c1af4 req-da699c7e-a430-4241-83c2-4408087905d8 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:29:55.103170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-6c58931a-02e8-457a-a413-8d081c8c1af4 req-da699c7e-a430-4241-83c2-4408087905d8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:29:55.103620 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-6c58931a-02e8-457a-a413-8d081c8c1af4 req-da699c7e-a430-4241-83c2-4408087905d8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:29:55.114681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-6c58931a-02e8-457a-a413-8d081c8c1af4 req-da699c7e-a430-4241-83c2-4408087905d8 service nova] Creating event network-changed:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:29:55.121173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-6c58931a-02e8-457a-a413-8d081c8c1af4 req-da699c7e-a430-4241-83c2-4408087905d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032545 Aug 04 21:29:55.121890 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 320/653] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:00.363029 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:00.365275 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:00.371337 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:00.371885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:00.372355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:00.373108 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:00.373567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:00.373988 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:00.402701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e3606e04-3866-47d1-8449-35953ea5847b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044172 Aug 04 21:30:00.403273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 334/654] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:30:00 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:30:00.472051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:00.476045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:00.478722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:00.479191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:00.479700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:00.480333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:00.480810 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:00.481222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:00.506161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:30:00.728944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5aaac5cd-db96-4736-8765-7f6420ae42fd tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 204 len: 0 microversion: 2.1 time: 0.261966 Aug 04 21:30:00.729537 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 321/655] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:30:00 2022] DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:30:00.738326 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:00.738865 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:00.744876 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:00.745354 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:00.745784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:00.746470 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:00.746914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:00.747388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:00.885572 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:00.893263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cfdd6faf-c07b-42bf-9505-ffa3a4276e53 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1675 microversion: 2.1 time: 0.159314 Aug 04 21:30:00.893837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 335/656] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:00 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:01.915719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:01.916411 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:01.923010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:01.923522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:01.924465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:01.925149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:01.925604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:01.926018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:02.072085 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:02.080130 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-467a002d-14eb-42d1-a224-a45c2e0052a5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1675 microversion: 2.1 time: 0.168382 Aug 04 21:30:02.080702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 322/657] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:01 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:02.141097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:02.141942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:02.149446 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:02.149927 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:02.150359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:02.151046 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:02.151537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:02.151960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:02.175562 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-312e8fdd-7046-44b9-9630-f050f9bbbfbc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/ips" status: 200 len: 147 microversion: 2.1 time: 0.041980 Aug 04 21:30:02.176049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 336/658] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:30:02 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:03.102003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:03.102655 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:03.104944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:03.109836 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:03.117510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:03.117510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:03.117510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:03.117510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:03.118222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:03.380150 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:03.387817 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0b9d952e-b2d3-464b-b33c-15b95c4cdf28 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1675 microversion: 2.1 time: 0.289624 Aug 04 21:30:03.388401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 323/659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:03 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:03.799816 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1de24563-efa3-4aba-9239-0ffb68729dff"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:03.802285 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:03.809265 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:03.809855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:03.810254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:03.810964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:03.811534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:03.811966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:04.119022 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-38721fa8-7ce5-4e1b-8ba4-3af7fb4fcc92 req-efb2bd2a-9e57-47f0-a952-bbb40a7168ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc8c40e-8238-4a1b-881e-1c681861109c", "name": "network-vif-deleted", "tag": "76ca3f71-a844-42f8-95d3-2811dedb3915"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:04.135202 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-38721fa8-7ce5-4e1b-8ba4-3af7fb4fcc92 req-efb2bd2a-9e57-47f0-a952-bbb40a7168ca service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:04.140831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-38721fa8-7ce5-4e1b-8ba4-3af7fb4fcc92 req-efb2bd2a-9e57-47f0-a952-bbb40a7168ca service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:04.140831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-38721fa8-7ce5-4e1b-8ba4-3af7fb4fcc92 req-efb2bd2a-9e57-47f0-a952-bbb40a7168ca service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:04.149230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-38721fa8-7ce5-4e1b-8ba4-3af7fb4fcc92 req-efb2bd2a-9e57-47f0-a952-bbb40a7168ca service nova] Creating event network-vif-deleted:76ca3f71-a844-42f8-95d3-2811dedb3915 for instance ebc8c40e-8238-4a1b-881e-1c681861109c on hv-cinder-85220 Aug 04 21:30:04.154469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-38721fa8-7ce5-4e1b-8ba4-3af7fb4fcc92 req-efb2bd2a-9e57-47f0-a952-bbb40a7168ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039565 Aug 04 21:30:04.155658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 324/660] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:04.409656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:04.410489 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:04.416832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:04.417391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:04.421744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:04.421744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:04.421744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:04.421744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:04.500931 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:04.508952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b821ea18-cfe1-42d9-8d2c-4fa8356a5ac5 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 200 len: 1323 microversion: 2.1 time: 0.103530 Aug 04 21:30:04.513845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 325/661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:04 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 1323 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:04.808222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1a4b8224-8487-4c51-981f-09fb8e1cafd6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012887 Aug 04 21:30:04.808834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 337/662] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:30:03 2022] POST /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments => generated 194 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:05.529637 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:05.530248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:05.536812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:05.537912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:05.537912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:05.538510 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:05.539006 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:05.539455 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:05.553333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] HTTP exception thrown: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Request method failure captured: Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c HTTP/1.1 Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlEWF7jM3QtRxC8gbdyszJRAr7zUYiHCXdB1WXsW3RhxF-KIB8TDbinHwo_glhlY7JvDLY9eGy5CPzxdCnu68QPuOLqA9CaMnxdL7-ETvoNmtvhrCS14f-siauZvxwTDXC_-lhMkDKBszdp5U7d75EUcfqw2-QhBeHFLI5v0qNSgrA Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:30:05.554635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00814c2455be4608b2984adcf6353df2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00814c2455be4608b2984adcf6353df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 9b29c3f2c29d4e2aba552c144cff94f8 Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:30:05.556161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'ebc8c40e-8238-4a1b-881e-1c681861109c'} Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:30:05.556977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:30:05.558383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:05.565340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Returning 404 to user: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:30:05.565340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fdba678b-5e14-4c35-85be-70b273476cbf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 404 len: 111 microversion: 2.1 time: 0.030280 Aug 04 21:30:05.565340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 326/663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:05 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:05.566696 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-24853729-bae7-4176-b4b8-cb453278832d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '.version_select at 0x7f8e70d553a0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:05.672726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-24853729-bae7-4176-b4b8-cb453278832d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345471452" status: 202 len: 0 microversion: 2.1 time: 0.111236 Aug 04 21:30:05.673338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 338/664] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Aug 4 21:30:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345471452 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:30:06.462842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-40ed675e-d975-4a67-bf65-46c942b4e70b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: .version_select at 0x7f8e70d88790>, body: {"keypair": {"name": "tempest-keypair-419165455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmX9iCn+/glDWpBILZwuSmjdCb28DX6HyJOwdmGuZcIvPau9a8ajbK82P3LvsvMpzWKdincF6VMDSi3jbyY+zt1v/17HVMvaZYJTc4/HBng7CawPEcQFvjy8pkIo6en+Q=="}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:06.482129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-40ed675e-d975-4a67-bf65-46c942b4e70b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for project 00814c2455be4608b2984adcf6353df2. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:30:06.487716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-40ed675e-d975-4a67-bf65-46c942b4e70b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for user 9b29c3f2c29d4e2aba552c144cff94f8 and project 00814c2455be4608b2984adcf6353df2. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:30:06.575698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-40ed675e-d975-4a67-bf65-46c942b4e70b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116600 Aug 04 21:30:06.576377 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 327/665] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:30:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:09.102016 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1129892943", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc67493d-9260-428c-aebc-c6f13345755b"}], "security_groups": [{"name": "tempest-securitygroup--980852091"}], "key_name": "tempest-keypair-419165455", "user_data": "}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:09.111170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:09.210203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] validate_networks() for [('bc67493d-9260-428c-aebc-c6f13345755b', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:30:09.585081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:30:09.585491 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:30:09.585976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:30:09.586377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:30:09.586778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:30:09.595543 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:09.596565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:09.596986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:09.597705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:09.598174 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:09.598589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:09.605191 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:09.616254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for project 00814c2455be4608b2984adcf6353df2. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:30:09.620134 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Getting quotas for user 9b29c3f2c29d4e2aba552c144cff94f8 and project 00814c2455be4608b2984adcf6353df2. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:30:09.631388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:30:09.633721 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:30:09.759772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a627cb85-b627-4874-bfcf-2a2908efa845 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.662334 Aug 04 21:30:09.760475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 339/666] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:30:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 21:30:09.772559 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-07d2e198-27a9-4077-9285-dbbd634b4d46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:09.773375 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-07d2e198-27a9-4077-9285-dbbd634b4d46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:09.907754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-07d2e198-27a9-4077-9285-dbbd634b4d46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:09.907754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-07d2e198-27a9-4077-9285-dbbd634b4d46 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1237 microversion: 2.1 time: 0.129418 Aug 04 21:30:09.907754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 328/667] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:09 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:10.918703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:10.919393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:10.927007 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:10.927526 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:10.927961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:10.928648 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:10.929102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:10.929545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:10.993958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:11.001726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e47cb2c9-2577-4d35-b111-040739af2bef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1241 microversion: 2.1 time: 0.087291 Aug 04 21:30:11.002933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 340/668] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:10 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:12.024872 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:12.025512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:12.031983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.032484 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.032913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.033594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.034038 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.034454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.101158 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:12.108735 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b5fbc6d0-0f90-4b9a-a3cf-c91acb260aaf tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1289 microversion: 2.1 time: 0.088089 Aug 04 21:30:12.109282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 329/669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:12 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:12.374361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1de24563-efa3-4aba-9239-0ffb68729dff"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:12.376805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:12.384466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.384942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.385370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.386051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.386499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.386920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.469003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Invalid volume: volume 1de24563-efa3-4aba-9239-0ffb68729dff is already attached to instances: 44f83e2f-66f7-470f-9782-5d9f3d4227c8 Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: POST /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments HTTP/1.1 Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 74 Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:30:12.470703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {"volumeAttachment": {"volumeId": "1de24563-efa3-4aba-9239-0ffb68729dff"}} Aug 04 21:30:12.476063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Invalid volume: volume 1de24563-efa3-4aba-9239-0ffb68729dff is already attached to instances: 44f83e2f-66f7-470f-9782-5d9f3d4227c8 Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'server_id': '44f83e2f-66f7-470f-9782-5d9f3d4227c8', 'body': {'volumeAttachment': {'volumeId': '1de24563-efa3-4aba-9239-0ffb68729dff'}}} Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1de24563-efa3-4aba-9239-0ffb68729dff is already attached to instances: 44f83e2f-66f7-470f-9782-5d9f3d4227c8 Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:12.477005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1de24563-efa3-4aba-9239-0ffb68729dff is already attached to instances: 44f83e2f-66f7-470f-9782-5d9f3d4227c8 Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:12.478112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1de24563-efa3-4aba-9239-0ffb68729dff is already attached to instances: 44f83e2f-66f7-470f-9782-5d9f3d4227c8 Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 400 to user: Invalid volume: volume 1de24563-efa3-4aba-9239-0ffb68729dff is already attached to instances: 44f83e2f-66f7-470f-9782-5d9f3d4227c8 {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6ab7ee95-0d5c-484d-96c4-39bfc55ed998 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102009 Aug 04 21:30:12.479267 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 341/670] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:30:12 2022] POST /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:30:12.540965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:12.541716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:12.549592 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.550190 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.550775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.551683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.552255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.552787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.645192 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'services' on Instance uuid 44f83e2f-66f7-470f-9782-5d9f3d4227c8 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:30:12.868004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-053d6e5e-1482-41da-8c9b-42c37f3fb10f tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments/1de24563-efa3-4aba-9239-0ffb68729dff" status: 202 len: 0 microversion: 2.1 time: 0.331548 Aug 04 21:30:12.869229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 330/671] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:30:12 2022] DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments/1de24563-efa3-4aba-9239-0ffb68729dff => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:30:12.877895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:12.880985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:12.890039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.890615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.891053 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.891812 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:12.892268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:12.892692 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:12.943920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c0158541-53f2-42f9-a1e0-3cd423ff67d5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069323 Aug 04 21:30:12.944552 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 342/672] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:30:12 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:13.130404 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:13.131275 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:13.138561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:13.139051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:13.139576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:13.140280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:13.140737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:13.141191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:13.222153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:13.232531 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-165d38f6-7a7a-4720-9796-997075de6580 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1307 microversion: 2.1 time: 0.106377 Aug 04 21:30:13.233120 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 331/673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:13 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:13.957608 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:13.960564 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:13.975909 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:13.984311 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:13.984760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:13.988674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:13.990341 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:13.990801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:14.029030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-85cd18ce-43e2-4d30-98eb-ab82895c5c27 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076029 Aug 04 21:30:14.029614 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 343/674] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:30:13 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:14.255082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:14.255937 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:14.262676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:14.263153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:14.263625 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:14.264325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:14.264787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:14.265216 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:14.507370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:14.515010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9b6f2f15-0540-458e-a5d7-702f118ea82a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.265270 Aug 04 21:30:14.515602 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 332/675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:14 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:14.725341 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-5803cfaf-1d53-4995-a767-d930af42089d req-5206546a-ab72-4e07-a1e0-1db649b50150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e4532c-ce69-433b-89ec-95849524f368", "tag": "5bc8673d-456c-4d4c-adfa-86e534e52cbb"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:14.735136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-5803cfaf-1d53-4995-a767-d930af42089d req-5206546a-ab72-4e07-a1e0-1db649b50150 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:14.736545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-5803cfaf-1d53-4995-a767-d930af42089d req-5206546a-ab72-4e07-a1e0-1db649b50150 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:14.736545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-5803cfaf-1d53-4995-a767-d930af42089d req-5206546a-ab72-4e07-a1e0-1db649b50150 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:14.749358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-5803cfaf-1d53-4995-a767-d930af42089d req-5206546a-ab72-4e07-a1e0-1db649b50150 service nova] Creating event network-changed:5bc8673d-456c-4d4c-adfa-86e534e52cbb for instance 41e4532c-ce69-433b-89ec-95849524f368 on hv-cinder-85220 Aug 04 21:30:14.754531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-5803cfaf-1d53-4995-a767-d930af42089d req-5206546a-ab72-4e07-a1e0-1db649b50150 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033849 Aug 04 21:30:14.755148 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 344/676] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:15.042298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:15.044851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:15.051002 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.051531 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.052091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.052780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.053319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.053662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.083991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fe53d71a-020f-4bcd-bdbf-9dd4fc4ce070 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045643 Aug 04 21:30:15.084580 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 333/677] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:30:15 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:30:15.148305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:15.148894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:15.155601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.156199 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.156638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.157336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.157793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.158220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.183585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:30:15.426877 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9aa474d8-c688-47a8-a3ed-9b77a44b7953 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 204 len: 0 microversion: 2.1 time: 0.282270 Aug 04 21:30:15.428154 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 345/678] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:30:15 2022] DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:30:15.438157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:15.438880 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:15.448407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.448990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.449578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.450477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.450775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.451154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.537788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:15.550659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:15.550659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.550659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.550659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.551088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:15.551088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:15.551088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:15.637863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:15.645564 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-60d97331-202b-47a7-a0d3-af5bc78ea076 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1678 microversion: 2.1 time: 0.211455 Aug 04 21:30:15.646147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 334/679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:15 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:15.683162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:15.691411 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-65179e4c-6c50-40d6-80ed-db362ee8ac97 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.159243 Aug 04 21:30:15.691978 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 346/680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:15 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:16.666769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:16.667375 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:16.673786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:16.674256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:16.674687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:16.675391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:16.675915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:16.676354 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:16.712406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:16.713013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:16.719514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:16.720001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:16.720429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:16.721136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:16.721590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:16.722014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:16.818798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:16.822687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:16.827625 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7f6fd7e4-d1f1-471d-8d90-20bf2ad91bf1 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1678 microversion: 2.1 time: 0.164838 Aug 04 21:30:16.828308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 335/681] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:16 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:16.871793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:16.880263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-21344278-d217-4520-a9e0-272e8682b053 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.171507 Aug 04 21:30:16.880891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 347/682] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:16 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:17.852126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:17.852729 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:17.860940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:17.861444 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:17.861873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:17.862770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:17.863219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:17.863665 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:17.901498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:17.902102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:17.909742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:17.910475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:17.913706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:17.914687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:17.915358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:17.916105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:18.094371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:18.114888 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-74f7d1b7-5acb-4cf0-81b2-e6b1911120b9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1678 microversion: 2.1 time: 0.267841 Aug 04 21:30:18.116179 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 336/683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:17 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1678 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:18.227138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:18.245093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cdd9d74f-d85d-4b49-a932-2a95f3f0ea90 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.346569 Aug 04 21:30:18.246330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 348/684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:17 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:19.114511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-e2dd1959-9faf-4bf8-9b62-8ce803cf1490 req-d934b252-9856-4da5-a958-55c25b42f934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f83e2f-66f7-470f-9782-5d9f3d4227c8", "name": "network-vif-deleted", "tag": "4ea314f7-5b91-4b3c-84cc-331f0a7fe38d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:19.125991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-e2dd1959-9faf-4bf8-9b62-8ce803cf1490 req-d934b252-9856-4da5-a958-55c25b42f934 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:19.126475 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-e2dd1959-9faf-4bf8-9b62-8ce803cf1490 req-d934b252-9856-4da5-a958-55c25b42f934 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:19.127107 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-e2dd1959-9faf-4bf8-9b62-8ce803cf1490 req-d934b252-9856-4da5-a958-55c25b42f934 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:19.139609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-e2dd1959-9faf-4bf8-9b62-8ce803cf1490 req-d934b252-9856-4da5-a958-55c25b42f934 service nova] Creating event network-vif-deleted:4ea314f7-5b91-4b3c-84cc-331f0a7fe38d for instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 on hv-cinder-85220 Aug 04 21:30:19.150918 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-e2dd1959-9faf-4bf8-9b62-8ce803cf1490 req-d934b252-9856-4da5-a958-55c25b42f934 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040260 Aug 04 21:30:19.154909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 337/685] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:19.274891 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:19.276038 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:19.282355 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:19.283210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:19.283931 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:19.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:19.285488 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:19.286122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:19.497933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:19.498556 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:19.512374 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:19.515392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:19.516032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:19.517040 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:19.519898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:19.520532 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:19.552740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:19.562390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-75198117-5d34-4957-97ce-c99116ab0f7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.293726 Aug 04 21:30:19.562640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:19.563121 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:19.563608 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:19.563951 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 338/686] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:19 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:19.564693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'fault' on Instance uuid 44f83e2f-66f7-470f-9782-5d9f3d4227c8 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:30:19.606930 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:19.621901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:19.625932 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=6 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:19.631745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c88bd980-f575-4886-b6c4-af6aaab39473 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 200 len: 1332 microversion: 2.1 time: 0.479602 Aug 04 21:30:19.632518 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 349/687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:19 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 1332 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:20.583993 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:20.584637 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:20.586810 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:20.592038 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:20.592517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:20.592955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:20.593648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:20.594099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:20.594522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:20.653434 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:20.654177 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:20.661647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:20.662208 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:20.662839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:20.663811 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:20.664297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:20.664722 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:20.681290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 HTTP/1.1 Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:30:20.682938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:30:20.686620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '44f83e2f-66f7-470f-9782-5d9f3d4227c8'} Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:30:20.687409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:30:20.689848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:20.691589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:30:20.691589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-24a9c12d-a243-4a0f-9c48-918227c82147 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 404 len: 111 microversion: 2.1 time: 0.034817 Aug 04 21:30:20.691589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 350/688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:20 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:30:20.694495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70dc4232-b429-4a52-b027-291cb0f435e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '.version_select at 0x7f8e70d41af0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:20.726097 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:20.733793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6449578f-9f4c-435b-9d35-c5efb039f6ef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.154325 Aug 04 21:30:20.734357 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 339/689] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:20 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:20.764211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-70dc4232-b429-4a52-b027-291cb0f435e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727020016" status: 202 len: 0 microversion: 2.1 time: 0.074727 Aug 04 21:30:20.764807 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 351/690] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Aug 4 21:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727020016 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:30:21.570211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-aad2c9c0-e20c-476e-b710-5c2dfcfcf6c5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: .version_select at 0x7f8e70ce0a60>, body: {"keypair": {"name": "tempest-keypair-292843009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS9LLI6mV3ObZOTydQgbLKj4NDMAQnoSXN9X9biIclFcTCoB/XsYwBZQlGP2RVnh7Mc+UG3L0NPCYCMtQV9Fktt0BhKlATwhZTi6s7p3PmFlaegrwPpPmz65EdG/F6n0g=="}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:21.586748 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-aad2c9c0-e20c-476e-b710-5c2dfcfcf6c5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:30:21.591248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-aad2c9c0-e20c-476e-b710-5c2dfcfcf6c5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'key_pairs'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:30:21.608249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-31598950-45ef-457b-b999-16c29698e001 req-3b49cc50-a9e8-4e37-8033-982546f19e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e4532c-ce69-433b-89ec-95849524f368", "name": "network-vif-plugged", "status": "completed", "tag": "5bc8673d-456c-4d4c-adfa-86e534e52cbb"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:21.619795 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-31598950-45ef-457b-b999-16c29698e001 req-3b49cc50-a9e8-4e37-8033-982546f19e4e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:21.622132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-31598950-45ef-457b-b999-16c29698e001 req-3b49cc50-a9e8-4e37-8033-982546f19e4e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:21.622680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-31598950-45ef-457b-b999-16c29698e001 req-3b49cc50-a9e8-4e37-8033-982546f19e4e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:21.635657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-31598950-45ef-457b-b999-16c29698e001 req-3b49cc50-a9e8-4e37-8033-982546f19e4e service nova] Creating event network-vif-plugged:5bc8673d-456c-4d4c-adfa-86e534e52cbb for instance 41e4532c-ce69-433b-89ec-95849524f368 on hv-cinder-85220 Aug 04 21:30:21.640904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-31598950-45ef-457b-b999-16c29698e001 req-3b49cc50-a9e8-4e37-8033-982546f19e4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036189 Aug 04 21:30:21.641681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 352/691] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:21.707888 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-aad2c9c0-e20c-476e-b710-5c2dfcfcf6c5 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141974 Aug 04 21:30:21.708509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 340/692] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:30:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:21.756488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:21.757181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:21.763770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:21.764237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:21.764677 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:21.765362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:21.765813 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:21.766235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:21.964668 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:21.972309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-bd84c4bd-7b6e-416d-a56c-987f97ed0276 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.220942 Aug 04 21:30:21.972901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 353/693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:21 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:22.993823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:22.994537 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:23.001584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:23.002860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:23.003633 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:23.004839 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:23.005671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:23.006211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:23.148699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:23.156539 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9ee5dc2a-77e0-491a-b2ce-0e1157bac64d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1362 microversion: 2.1 time: 0.167099 Aug 04 21:30:23.157340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 341/694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:22 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:24.013548 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1185257320", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f302c59-fa86-42bc-8bff-0f7c4eefd06a"}], "security_groups": [{"name": "tempest-securitygroup--1935807106"}], "key_name": "tempest-keypair-292843009", "user_data": "}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:24.056151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:24.056639 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:24.062962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.063474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.064620 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.065390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.065851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.066273 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.129719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.network.neutron [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] validate_networks() for [('8f302c59-fa86-42bc-8bff-0f7c4eefd06a', None, None, None, None, None)] {{(pid=118549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:30:24.156799 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lazy-loading 'services' on Instance uuid fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:30:24.402191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6041907f-8fc5-4bff-985d-1723f0b17994 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments/98a81a58-5029-4df8-9f6e-1e07000e2cac" status: 202 len: 0 microversion: 2.1 time: 0.349882 Aug 04 21:30:24.403547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 342/695] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:30:24 2022] DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments/98a81a58-5029-4df8-9f6e-1e07000e2cac => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:30:24.411775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:24.412609 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:24.419123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.419851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.420290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.421059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.421668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.422093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.567061 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:30:24.567547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image limits 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:30:24.568106 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Flavor pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:30:24.568753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Image pref 0:0:0 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:30:24.569167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.virt.hardware [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:30:24.577923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.578406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.579243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.580118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.580746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.581171 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.581551 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:24.589440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-79bc0df8-479f-4a5d-b190-1056e02a5797 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1549 microversion: 2.1 time: 0.181811 Aug 04 21:30:24.590052 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 343/696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:24 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:24.594642 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:24.597114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:24.599248 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:30:24.603616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.603888 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Getting quotas for user ea2f8480bc7d44f6a51e4a1d875a1c7c and project f28e5935db5c4be4871d727e1958424b. Resources: {'instances', 'ram', 'cores'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:30:24.604096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.604527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.605398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.606278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.606707 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.617180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Going to run 1 instances... {{(pid=118549) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:30:24.619987 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:30:24.643121 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f07183e6-fad3-4194-bd7c-ae2613fe0367 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052006 Aug 04 21:30:24.643733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 344/697] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:30:24 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:24.648350 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:24.648836 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:24.655114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.655840 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.656276 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.656973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:24.657427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:24.657879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:24.737924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c2782250-aca9-4a24-88e4-68e8651b7031 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093057 Aug 04 21:30:24.738515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 345/698] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:30:24 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:24.776228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-03424d30-90b1-423e-981d-f5255aa7694c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.766968 Aug 04 21:30:24.782794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 354/699] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:30:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:30:24.788442 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f7e0198b-b27f-4963-84e0-eda24c6e412d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:24.789042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f7e0198b-b27f-4963-84e0-eda24c6e412d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:24.892265 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f7e0198b-b27f-4963-84e0-eda24c6e412d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:24.899989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f7e0198b-b27f-4963-84e0-eda24c6e412d tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1241 microversion: 2.1 time: 0.115213 Aug 04 21:30:24.900985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 346/700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:24 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:25.660065 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:25.663361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:25.671841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:25.672333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:25.672771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:25.673466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:25.674494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:25.674959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:25.710661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b15123df-b190-41cd-8387-3d6c8c11a395 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055986 Aug 04 21:30:25.711239 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 355/701] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:30:25 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:30:25.802943 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:25.803700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:25.811598 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:25.812435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:25.812961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:25.813601 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:25.814156 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:25.814734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:25.846100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:30:25.922338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-16bfd87f-f153-4124-b31f-c536638d7dc6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:25.922910 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-16bfd87f-f153-4124-b31f-c536638d7dc6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:25.980769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-16bfd87f-f153-4124-b31f-c536638d7dc6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:25.988904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-16bfd87f-f153-4124-b31f-c536638d7dc6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1241 microversion: 2.1 time: 0.070778 Aug 04 21:30:25.989489 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 356/702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:25 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:26.094967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2cea257d-47dc-448f-8639-473a6a4257f9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 204 len: 0 microversion: 2.1 time: 0.299504 Aug 04 21:30:26.096298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 347/703] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:30:25 2022] DELETE /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:30:26.104262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:26.104866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:26.110715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:26.111937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:26.112691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:26.114755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:26.114755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:26.114755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:26.262676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:26.275114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1f5900ff-5823-4309-9d1c-5b672fa1e53d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1690 microversion: 2.1 time: 0.174479 Aug 04 21:30:26.280052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 357/704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:26 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:26.290842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-39ab0ed4-a975-4b1e-8b09-a438816420fd req-94e9ab35-0fc9-498e-bd03-1a7497d56494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e4532c-ce69-433b-89ec-95849524f368", "tag": "5bc8673d-456c-4d4c-adfa-86e534e52cbb"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:26.300247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-39ab0ed4-a975-4b1e-8b09-a438816420fd req-94e9ab35-0fc9-498e-bd03-1a7497d56494 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:26.300719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-39ab0ed4-a975-4b1e-8b09-a438816420fd req-94e9ab35-0fc9-498e-bd03-1a7497d56494 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:26.301141 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-39ab0ed4-a975-4b1e-8b09-a438816420fd req-94e9ab35-0fc9-498e-bd03-1a7497d56494 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:26.312160 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-39ab0ed4-a975-4b1e-8b09-a438816420fd req-94e9ab35-0fc9-498e-bd03-1a7497d56494 service nova] Creating event network-changed:5bc8673d-456c-4d4c-adfa-86e534e52cbb for instance 41e4532c-ce69-433b-89ec-95849524f368 on hv-cinder-85220 Aug 04 21:30:26.317454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-39ab0ed4-a975-4b1e-8b09-a438816420fd req-94e9ab35-0fc9-498e-bd03-1a7497d56494 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030920 Aug 04 21:30:26.318590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 348/705] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:30:27.009539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:27.010144 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:27.016947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:27.017688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:27.018119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:27.018809 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:27.019254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:27.019697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:27.085970 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:27.093603 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-05d64214-ff76-4895-afd9-a928766056ff tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1245 microversion: 2.1 time: 0.087913 Aug 04 21:30:27.094179 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 358/706] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:27 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:27.300771 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:27.301463 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:27.308125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:27.308603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:27.309035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:27.309736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:27.310184 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:27.310606 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:27.450545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:27.458904 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-72341cbf-c77a-465a-a448-d01327fbc106 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1690 microversion: 2.1 time: 0.163371 Aug 04 21:30:27.459474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 349/707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:27 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:28.114634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:28.115231 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:28.122628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:28.123184 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:28.123717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:28.124444 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:28.124891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:28.125308 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:28.129042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:28.195275 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:28.206949 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-69ceb750-fe55-4188-bd18-61221e53b94e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1245 microversion: 2.1 time: 0.093157 Aug 04 21:30:28.206949 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 359/708] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:28 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:28.480880 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:28.481512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:28.488468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:28.488947 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:28.489388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:28.490090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:28.490545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:28.490967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:28.622858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:28.630390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b751f265-125b-4d7c-b196-00e6c7b4edb9 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1690 microversion: 2.1 time: 0.153328 Aug 04 21:30:28.631293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 350/709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:28 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:29.229831 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:29.230573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:29.240967 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:29.241536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:29.241984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:29.242681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:29.243135 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:29.243585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:29.328356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:29.337028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-202ab0fc-9b8b-408c-9369-cfe695a18971 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1245 microversion: 2.1 time: 0.114066 Aug 04 21:30:29.337608 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 360/710] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:29 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:29.652272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:29.652871 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:29.669316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:29.689148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:29.689148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:29.689148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:29.689148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:29.689811 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:29.934747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:29.943174 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2c0082f3-d57f-4aec-a13a-0d828ae7758f tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1690 microversion: 2.1 time: 0.294718 Aug 04 21:30:29.944426 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 351/711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:29 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:30.400936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:30.400936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:30.400936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:30.400936 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:30.401616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:30.401616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:30.401616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:30.401616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:30.434662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:30.442671 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ccdada4b-e449-4854-ae96-ff8b4678dc5e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1293 microversion: 2.1 time: 0.088183 Aug 04 21:30:30.449706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 361/712] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:30 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:30.617006 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-954503c7-b39a-4cde-9f03-a7761fdd6b1d req-9c96c11d-32cf-478b-b097-e7857ebc6644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf22c7f-6277-4d8e-b3f2-fae569fdcb65", "name": "network-vif-deleted", "tag": "ed85d1f1-7378-435e-90bf-f89e3fc4e6dc"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:30.632258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-954503c7-b39a-4cde-9f03-a7761fdd6b1d req-9c96c11d-32cf-478b-b097-e7857ebc6644 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:30.632728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-954503c7-b39a-4cde-9f03-a7761fdd6b1d req-9c96c11d-32cf-478b-b097-e7857ebc6644 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:30.633149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-954503c7-b39a-4cde-9f03-a7761fdd6b1d req-9c96c11d-32cf-478b-b097-e7857ebc6644 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:30.649125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-954503c7-b39a-4cde-9f03-a7761fdd6b1d req-9c96c11d-32cf-478b-b097-e7857ebc6644 service nova] Creating event network-vif-deleted:ed85d1f1-7378-435e-90bf-f89e3fc4e6dc for instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 on hv-cinder-85220 Aug 04 21:30:30.654940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-954503c7-b39a-4cde-9f03-a7761fdd6b1d req-9c96c11d-32cf-478b-b097-e7857ebc6644 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046767 Aug 04 21:30:30.657801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 352/713] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:30.966252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:30.966866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:30.973032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:30.973574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:30.974007 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:30.974750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:30.975407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:30.976018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:31.049541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:31.081947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1c4e4ee7-daf8-4e89-962f-a9668dbe23f0 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 200 len: 1330 microversion: 2.1 time: 0.119473 Aug 04 21:30:31.083935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 362/714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:30 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:31.466036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:31.466771 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:31.476171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:31.476829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:31.477505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:31.478298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:31.478830 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:31.479344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:31.558342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:31.566353 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-16f0a0d2-10d8-4c59-b4db-23e5ac552ac7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1299 microversion: 2.1 time: 0.105277 Aug 04 21:30:31.567403 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 353/715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:31 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:32.105806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:32.105806 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: fbf22c7f-6277-4d8e-b3f2-fae569fdcb65] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:32.114431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:32.115169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:32.115715 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:32.116726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:32.117597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:32.118273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:32.134580 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] HTTP exception thrown: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 could not be found. Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Request method failure captured: Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 HTTP/1.1 Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk60dmJwv_DBHx-KVKMsfB6ewGKd9IIjuZmlw4lUiv3rZOeSMbMO7Eqdgejm3iM__A7OHbVi6-MlaNnC8DSqhoPyvYQP46rQ3zd_4srmtPoFstteE053HP8N4yYA9rEUApWIZizVzZbEILj6HgVo4Y_DPM6Gmez2NM21RNDWH73pOE Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:30:32.136459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 3d5f53509b2f42269cd26e77c79ad8be Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 could not be found. Aug 04 21:30:32.140727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'fbf22c7f-6277-4d8e-b3f2-fae569fdcb65'} Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 could not be found. Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:30:32.141665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 could not be found. Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 could not be found. Aug 04 21:30:32.147266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:32.148621 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Returning 404 to user: Instance fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:30:32.148621 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b3063114-ea6d-47f5-8524-7214aa997fda tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65" status: 404 len: 111 microversion: 2.1 time: 0.037778 Aug 04 21:30:32.148621 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 363/716] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:32 2022] GET /compute/v2.1/servers/fbf22c7f-6277-4d8e-b3f2-fae569fdcb65 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:32.150018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e155bf1f-8869-416b-a7be-393389c5f332 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '.version_select at 0x7f8e70d1d940>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:32.224470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e155bf1f-8869-416b-a7be-393389c5f332 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651473525" status: 202 len: 0 microversion: 2.1 time: 0.078513 Aug 04 21:30:32.225256 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 354/717] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Aug 4 21:30:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651473525 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:30:32.591829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:32.592676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:32.599383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:32.607898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:32.607898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:32.607898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:32.607898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:32.608623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:32.756405 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:32.764943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-aeb15f47-179c-4890-8e7c-d9c653b223ab tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.176893 Aug 04 21:30:32.777157 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 364/718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:32 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:32.782243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-61e3967d-121c-471b-8dac-c8259b1e0985 req-019fd42a-7662-4edc-9ffa-4151b6c7d7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4e2a920-b408-431f-9985-811e1baf27e1", "tag": "11484221-608a-4c80-8cfc-6c37d7c9b9d0"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:32.791690 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-61e3967d-121c-471b-8dac-c8259b1e0985 req-019fd42a-7662-4edc-9ffa-4151b6c7d7b9 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:32.792245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-61e3967d-121c-471b-8dac-c8259b1e0985 req-019fd42a-7662-4edc-9ffa-4151b6c7d7b9 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:32.792766 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-61e3967d-121c-471b-8dac-c8259b1e0985 req-019fd42a-7662-4edc-9ffa-4151b6c7d7b9 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:32.808341 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-61e3967d-121c-471b-8dac-c8259b1e0985 req-019fd42a-7662-4edc-9ffa-4151b6c7d7b9 service nova] Creating event network-changed:11484221-608a-4c80-8cfc-6c37d7c9b9d0 for instance e4e2a920-b408-431f-9985-811e1baf27e1 on hv-cinder-85220 Aug 04 21:30:32.813521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-61e3967d-121c-471b-8dac-c8259b1e0985 req-019fd42a-7662-4edc-9ffa-4151b6c7d7b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037588 Aug 04 21:30:32.814926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 355/719] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:33.786749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:33.787484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:33.795107 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:33.795901 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:33.796496 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:33.797481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:33.798189 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:33.798838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:33.957369 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:33.965342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8d57545e-d682-4a4f-bd7e-b7e41237609c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.182422 Aug 04 21:30:33.966591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 365/720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:33 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:34.994782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:34.999200 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:35.000045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:35.001765 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:35.006891 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:35.008176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:35.008176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:35.008419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:35.008876 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:35.009298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:35.014002 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:35.160169 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:35.167928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-97bb04b3-76a2-4f08-bc5d-3e9e8d599137 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.174673 Aug 04 21:30:35.168511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 356/721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:34 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:35.687090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:35.687634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:35.691441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:35.695956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:35.696416 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:35.702789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:35.702789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:35.702789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:35.702789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:35.726768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:30:35.981937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:35.986693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=8 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:36.077713 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a795e803-79c5-497d-b014-71d471892dc5 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 204 len: 0 microversion: 2.1 time: 0.394363 Aug 04 21:30:36.078447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 366/722] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:30:35 2022] DELETE /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:30:36.086881 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:36.087533 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:36.099019 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:36.099546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:36.099984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:36.100696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:36.101205 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:36.101631 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:36.190073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:36.190786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:36.202947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:36.203114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:36.203442 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:36.204134 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:36.204802 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:36.205214 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:36.255348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:36.263151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e5eb3ccb-8626-4051-bc82-c6193fe9061c tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1508 microversion: 2.1 time: 0.180468 Aug 04 21:30:36.263840 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 357/723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:36 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:36.366007 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:36.374277 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c1106459-720c-43c9-9436-fc6b6ecf9815 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.188490 Aug 04 21:30:36.379952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 367/724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:36 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:37.286621 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:37.287214 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:37.294356 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:37.300365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:37.300365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:37.300365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:37.300365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:37.300821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:37.395381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:37.396256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:37.402942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:37.409278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:37.409278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:37.409278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:37.409278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:37.409704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:37.436905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:37.445776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0525b74d-d6c0-43d6-8149-7827f73b77e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1508 microversion: 2.1 time: 0.164353 Aug 04 21:30:37.448901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 358/725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:37 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:37.559220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:37.569049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9c77dc5d-ad4a-478b-a551-f13603a92198 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.178436 Aug 04 21:30:37.569854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 368/726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:37 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:37.694582 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-8cec9a77-b8a9-4ca1-8e32-d7872ca8dcd8 req-a5c6e526-b700-4b11-816b-e03abd73f9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e2a920-b408-431f-9985-811e1baf27e1", "name": "network-vif-plugged", "status": "completed", "tag": "11484221-608a-4c80-8cfc-6c37d7c9b9d0"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:37.704731 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8cec9a77-b8a9-4ca1-8e32-d7872ca8dcd8 req-a5c6e526-b700-4b11-816b-e03abd73f9a8 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:37.705202 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8cec9a77-b8a9-4ca1-8e32-d7872ca8dcd8 req-a5c6e526-b700-4b11-816b-e03abd73f9a8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:37.705628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8cec9a77-b8a9-4ca1-8e32-d7872ca8dcd8 req-a5c6e526-b700-4b11-816b-e03abd73f9a8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:37.718366 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-8cec9a77-b8a9-4ca1-8e32-d7872ca8dcd8 req-a5c6e526-b700-4b11-816b-e03abd73f9a8 service nova] Creating event network-vif-plugged:11484221-608a-4c80-8cfc-6c37d7c9b9d0 for instance e4e2a920-b408-431f-9985-811e1baf27e1 on hv-cinder-85220 Aug 04 21:30:37.723704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-8cec9a77-b8a9-4ca1-8e32-d7872ca8dcd8 req-a5c6e526-b700-4b11-816b-e03abd73f9a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Aug 04 21:30:37.724301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 359/727] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:38.467999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:38.468647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:38.474773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:38.475258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:38.475739 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:38.476428 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:38.476949 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:38.477371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:38.620925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:38.625960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:38.628898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:38.629714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:38.630261 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:38.631230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:38.631944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:38.632578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:38.666628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:38.667536 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1af48f17-4261-4597-9a02-3b7026309255 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/ips" status: 200 len: 152 microversion: 2.20 time: 0.130363 Aug 04 21:30:38.668247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 360/728] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Aug 4 21:30:38 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/ips => generated 152 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 21:30:38.675968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:38.677231 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-efa9b781-5416-4186-a53d-267ecea69944 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1508 microversion: 2.1 time: 0.213633 Aug 04 21:30:38.677507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:38.677825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 369/729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:38 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:38.689519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:38.689519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:38.689519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:38.689519 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:38.689914 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:38.689914 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:38.955162 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:38.968974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1dcfd702-3978-4aac-a056-0d5ea99ccac2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.299480 Aug 04 21:30:38.969873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 361/730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:38 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:39.457273 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-32aecdf2-68de-4c5e-be00-2c9b36f5c6b7 req-fb70b740-389b-4806-8491-ac6d848d93fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b93cdf-c7eb-4067-8185-b6d326af5df1", "name": "network-vif-deleted", "tag": "a82796a1-f3b1-4ad6-aba1-2ffd6d2e6320"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:39.471514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-32aecdf2-68de-4c5e-be00-2c9b36f5c6b7 req-fb70b740-389b-4806-8491-ac6d848d93fa service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:39.477187 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-32aecdf2-68de-4c5e-be00-2c9b36f5c6b7 req-fb70b740-389b-4806-8491-ac6d848d93fa service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:39.477187 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-32aecdf2-68de-4c5e-be00-2c9b36f5c6b7 req-fb70b740-389b-4806-8491-ac6d848d93fa service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:39.489939 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-32aecdf2-68de-4c5e-be00-2c9b36f5c6b7 req-fb70b740-389b-4806-8491-ac6d848d93fa service nova] Creating event network-vif-deleted:a82796a1-f3b1-4ad6-aba1-2ffd6d2e6320 for instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 on hv-cinder-85220 Aug 04 21:30:39.495945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-32aecdf2-68de-4c5e-be00-2c9b36f5c6b7 req-fb70b740-389b-4806-8491-ac6d848d93fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117743 Aug 04 21:30:39.497228 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 370/731] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:39.702578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:39.703186 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:39.717227 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:39.718051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:39.718822 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:39.720147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:39.720814 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:39.721372 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:39.801786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:39.811054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8f0bbe8d-62d9-4ad9-af3d-bedb94b9f58d tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1293 microversion: 2.1 time: 0.112344 Aug 04 21:30:39.813072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 362/732] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:39 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:39.993852 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:39.994558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:40.006999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.006999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.006999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.006999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.007333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.007333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.157460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:40.165640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-29b3c99d-acc0-44cf-92b0-2f2c28c06378 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1367 microversion: 2.1 time: 0.176161 Aug 04 21:30:40.166210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 371/733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:39 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:40.834904 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:40.835548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:40.842339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.843146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.843624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.844323 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.844770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.845235 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.881685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.882170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.882598 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.883043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lazy-loading 'fault' on Instance uuid f4b93cdf-c7eb-4067-8185-b6d326af5df1 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:30:40.931673 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:40.940962 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:40.941542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:40.946224 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e2c12cb2-5c0c-4a2e-bbe4-1802e0d61cad tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 200 len: 1312 microversion: 2.1 time: 0.114850 Aug 04 21:30:40.947239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 363/734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:40 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:40.951701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.952332 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.952862 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.953661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:40.954203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:40.955005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:40.983989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lazy-loading 'flavor' on Instance uuid 57d64b73-0f15-4da6-b57b-6348065daa31 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:30:41.186959 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:41.187787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:41.197048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.197496 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.197996 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.199329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.200271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.200747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.383598 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:41.392049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4abb4547-245d-4c23-b8cb-bbc39911b7e4 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1556 microversion: 2.1 time: 0.208810 Aug 04 21:30:41.392893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 364/735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:41 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:41.420829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:41.421420 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:41.428338 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.431266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.431266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.431266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.431266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.431751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.517104 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ce3c9c12-3011-421e-a179-d0b019c62e8e tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104214 Aug 04 21:30:41.518805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 365/736] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Aug 4 21:30:41 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:41.600733 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-73ccd574-937a-4625-b10d-425e4c38d680 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/action" status: 202 len: 0 microversion: 2.20 time: 0.664886 Aug 04 21:30:41.603372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 372/737] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Aug 4 21:30:40 2022] POST /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:30:41.611043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:41.611940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:41.619034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.619859 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.620786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.621687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.622302 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.622948 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.804450 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:41.812727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:41.814280 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:41.815498 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-06ae7484-e97f-4f31-908a-170f144c8a92 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.209386 Aug 04 21:30:41.819370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 366/738] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:41 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:41.971120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:41.971838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: f4b93cdf-c7eb-4067-8185-b6d326af5df1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:41.979355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.979844 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.980275 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.981148 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:41.981597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:41.982020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:41.999137 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] HTTP exception thrown: Instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 could not be found. Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Request method failure captured: Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 HTTP/1.1 Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk60dmJwv_DBHx-KVKMsfB6ewGKd9IIjuZmlw4lUiv3rZOeSMbMO7Eqdgejm3iM__A7OHbVi6-MlaNnC8DSqhoPyvYQP46rQ3zd_4srmtPoFstteE053HP8N4yYA9rEUApWIZizVzZbEILj6HgVo4Y_DPM6Gmez2NM21RNDWH73pOE Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:30:42.001064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 3d5f53509b2f42269cd26e77c79ad8be Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 could not be found. Aug 04 21:30:42.002935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'f4b93cdf-c7eb-4067-8185-b6d326af5df1'} Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 could not be found. Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:30:42.003693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 could not be found. Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 could not be found. Aug 04 21:30:42.004977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:30:42.007056 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Returning 404 to user: Instance f4b93cdf-c7eb-4067-8185-b6d326af5df1 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:30:42.007056 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9dd3e33f-a83e-4eb3-9202-0cdd368a64e2 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1" status: 404 len: 111 microversion: 2.1 time: 0.037158 Aug 04 21:30:42.011529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:42.012349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:42.017126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 373/739] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:41 2022] GET /compute/v2.1/servers/f4b93cdf-c7eb-4067-8185-b6d326af5df1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:42.019116 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.019817 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.020490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.021178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.021604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.022051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.049061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:30:42.426060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b0891226-78f5-4acb-bb2e-342571550343 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 204 len: 0 microversion: 2.1 time: 0.418025 Aug 04 21:30:42.426884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 367/740] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:30:42 2022] DELETE /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:30:42.435047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:42.436682 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:42.442377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.443305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.444230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.445114 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.445726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.446327 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.451990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:42.673724 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:42.682731 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-63a721f7-3cce-44d5-9198-4c8699fb3a74 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.251458 Aug 04 21:30:42.683697 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 374/741] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:42 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:42.840383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:42.840999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:42.853198 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.853682 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.854115 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.854805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.855251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.855704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.918272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-4fb5ce72-12f3-4da5-b6ea-bfbbfa027dbd req-aca82cdb-b633-4aed-b0a0-66294cb3e4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4e2a920-b408-431f-9985-811e1baf27e1", "tag": "11484221-608a-4c80-8cfc-6c37d7c9b9d0"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:42.937867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-4fb5ce72-12f3-4da5-b6ea-bfbbfa027dbd req-aca82cdb-b633-4aed-b0a0-66294cb3e4d1 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:42.939397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-4fb5ce72-12f3-4da5-b6ea-bfbbfa027dbd req-aca82cdb-b633-4aed-b0a0-66294cb3e4d1 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:42.941068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-4fb5ce72-12f3-4da5-b6ea-bfbbfa027dbd req-aca82cdb-b633-4aed-b0a0-66294cb3e4d1 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:42.971933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-4fb5ce72-12f3-4da5-b6ea-bfbbfa027dbd req-aca82cdb-b633-4aed-b0a0-66294cb3e4d1 service nova] Creating event network-changed:11484221-608a-4c80-8cfc-6c37d7c9b9d0 for instance e4e2a920-b408-431f-9985-811e1baf27e1 on hv-cinder-85220 Aug 04 21:30:42.980000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-4fb5ce72-12f3-4da5-b6ea-bfbbfa027dbd req-aca82cdb-b633-4aed-b0a0-66294cb3e4d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150741 Aug 04 21:30:42.980725 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 368/742] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:43.046159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:43.055432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:43.056912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:43.058055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-826e0bc7-225b-4dc0-844a-8fd344650a63 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.221492 Aug 04 21:30:43.071767 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 375/743] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:42 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:30:43.706520 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:43.707202 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:43.713944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:43.714727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:43.715024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:43.715547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:43.715995 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:43.716407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:43.861949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:43.869873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d9833b7d-bf33-494d-af0d-ab97d301768a tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.168696 Aug 04 21:30:43.870485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 369/744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:43 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:44.081985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:44.082582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:44.089222 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:44.089695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:44.090125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:44.090804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:44.091245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:44.091684 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:44.232380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:44.241851 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:44.243414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:44.244587 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d071e11b-a5c2-4129-86e2-5dcc21a20c26 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.166500 Aug 04 21:30:44.245136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 376/745] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:44 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:30:44.892472 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:44.893129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:44.901845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:44.902330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:44.902763 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:44.903509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:44.903957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:44.904381 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:45.054094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:45.061717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3095aa52-2eb0-45a8-a519-d6cad07d3e65 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.173524 Aug 04 21:30:45.063285 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 370/746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:44 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:45.269481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:45.270088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:45.276506 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:45.276989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:45.277424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:45.278140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:45.278712 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:45.279139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:45.413088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:45.421519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:45.423099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:45.424763 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0e6cdc7f-481e-4a08-8138-d12d1a3ff68e tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.159798 Aug 04 21:30:45.425429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 377/747] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:45 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:46.085486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:46.086195 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:46.093052 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:46.094481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:46.094481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:46.094693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:46.096238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:46.096238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:46.239800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:46.247674 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1095557c-0577-4571-bd10-3b7c25959a49 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1522 microversion: 2.1 time: 0.166174 Aug 04 21:30:46.248258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 371/748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:46 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:30:46.450955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:46.451747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:46.459309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:46.459825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:46.460245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:46.460980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:46.461431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:46.461850 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:46.488841 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-f38e6822-eed8-4c9b-a293-4ef46daf0c48 req-e25b3eac-7a48-468b-910e-9614308a050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9430424-4bb5-460d-a72c-98c2299395d1", "name": "network-vif-deleted", "tag": "c8cba2cc-841c-408c-b9e2-5ff3b32f7242"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:46.501899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-f38e6822-eed8-4c9b-a293-4ef46daf0c48 req-e25b3eac-7a48-468b-910e-9614308a050d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:46.510061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-f38e6822-eed8-4c9b-a293-4ef46daf0c48 req-e25b3eac-7a48-468b-910e-9614308a050d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:46.510061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-f38e6822-eed8-4c9b-a293-4ef46daf0c48 req-e25b3eac-7a48-468b-910e-9614308a050d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:46.514924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-f38e6822-eed8-4c9b-a293-4ef46daf0c48 req-e25b3eac-7a48-468b-910e-9614308a050d service nova] Creating event network-vif-deleted:c8cba2cc-841c-408c-b9e2-5ff3b32f7242 for instance e9430424-4bb5-460d-a72c-98c2299395d1 on hv-cinder-85220 Aug 04 21:30:46.520334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-f38e6822-eed8-4c9b-a293-4ef46daf0c48 req-e25b3eac-7a48-468b-910e-9614308a050d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Aug 04 21:30:46.520962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 372/749] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:30:46.602218 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:46.610262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:46.611943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:46.613159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-aed2e56c-532e-4ef7-b32f-c34689b142ea tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.166102 Aug 04 21:30:46.613667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 378/750] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:46 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:47.270921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:47.271788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:47.278218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:47.278697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:47.279155 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:47.279876 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:47.280327 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:47.280746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:47.299713 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:47.319750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:47.320234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:47.320667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:47.321113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lazy-loading 'fault' on Instance uuid e9430424-4bb5-460d-a72c-98c2299395d1 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:30:47.367390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5f53509b2f42269cd26e77c79ad8be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc9fe2e0830451c823180afe60ec921', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:47.375055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2da754a9-917d-4deb-8b59-c240b6312846 tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 200 len: 1311 microversion: 2.1 time: 0.108804 Aug 04 21:30:47.375712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 373/751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:47 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:30:47.636507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:47.637080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:47.644118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:47.644807 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:47.646026 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:47.646210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:47.647241 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:47.647501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:47.780832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:47.789764 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:47.791288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:47.792454 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-29e35adc-03d7-4d12-810b-a1d638a1fc96 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.159959 Aug 04 21:30:47.793021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 379/752] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:47 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:48.396433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:48.396989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] [instance: e9430424-4bb5-460d-a72c-98c2299395d1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:48.404013 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:48.404490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:48.404919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:48.405603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:48.406052 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:48.406473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:48.419487 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] HTTP exception thrown: Instance e9430424-4bb5-460d-a72c-98c2299395d1 could not be found. Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Request method failure captured: Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 HTTP/1.1 Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk60dmJwv_DBHx-KVKMsfB6ewGKd9IIjuZmlw4lUiv3rZOeSMbMO7Eqdgejm3iM__A7OHbVi6-MlaNnC8DSqhoPyvYQP46rQ3zd_4srmtPoFstteE053HP8N4yYA9rEUApWIZizVzZbEILj6HgVo4Y_DPM6Gmez2NM21RNDWH73pOE Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:30:48.421142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0cc9fe2e0830451c823180afe60ec921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 0cc9fe2e0830451c823180afe60ec921 Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1151086051 Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 3d5f53509b2f42269cd26e77c79ad8be Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1151086051-project Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance e9430424-4bb5-460d-a72c-98c2299395d1 could not be found. Aug 04 21:30:48.422706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'e9430424-4bb5-460d-a72c-98c2299395d1'} Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9430424-4bb5-460d-a72c-98c2299395d1 could not be found. Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:30:48.424211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9430424-4bb5-460d-a72c-98c2299395d1 could not be found. Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9430424-4bb5-460d-a72c-98c2299395d1 could not be found. Aug 04 21:30:48.425838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:30:48.427236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] Returning 404 to user: Instance e9430424-4bb5-460d-a72c-98c2299395d1 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:30:48.427236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ee6ad424-b7a7-4db2-a407-eb62ae69b7ca tempest-ServerRescueNegativeTestJSON-1151086051 tempest-ServerRescueNegativeTestJSON-1151086051-project] 10.222.0.25 "GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1" status: 404 len: 111 microversion: 2.1 time: 0.030055 Aug 04 21:30:48.427236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 374/753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:30:48 2022] GET /compute/v2.1/servers/e9430424-4bb5-460d-a72c-98c2299395d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:48.814948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:48.815686 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:48.822865 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:48.823726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:48.823889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:48.824515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:48.824997 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:48.825422 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:49.103694 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:49.111835 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:49.113341 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:49.114529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c64e1a80-1b18-4bf9-b7d3-f85903ed022b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.303666 Aug 04 21:30:49.115102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 380/754] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:48 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:50.137504 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:50.138212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:50.152030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:50.152030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:50.152030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:50.152030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:50.152649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:50.152649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:50.295212 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:50.303968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:50.305476 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:50.306639 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0fd476dc-dbf8-445c-9e1f-3e7a57095c32 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.173121 Aug 04 21:30:50.307876 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 375/755] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:50 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:51.332184 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:51.332768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:51.340600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:51.340846 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:51.341449 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:51.342143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:51.342587 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:51.343001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:51.496958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:51.505083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:51.506785 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:51.508268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-68529e20-9601-4315-9d44-e91eaaecfab2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.180979 Aug 04 21:30:51.508837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 381/756] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:51 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:52.532290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:52.533432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:52.540003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:52.540478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:52.540908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:52.541690 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:52.542481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:52.543243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:52.688520 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:52.697194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:52.698686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:52.699878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-29bc81c8-0785-448c-a6b8-45e70f46dd6d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1744 microversion: 2.20 time: 0.171861 Aug 04 21:30:52.700420 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 376/757] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:52 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:53.727693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:53.728463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:53.735298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:53.736307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:53.736843 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:53.737752 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:53.738236 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:53.738816 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:53.895895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:53.905554 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:53.906997 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:53.908269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c10dc243-24cb-4a06-af31-be2ed9bcef33 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1744 microversion: 2.20 time: 0.184783 Aug 04 21:30:53.909095 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 382/758] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:53 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:30:54.932045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:54.932645 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:54.939784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:54.940260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:54.940692 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:54.941390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:54.941841 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:54.942263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:55.081340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:55.090594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:55.092136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:55.093293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b1441046-de6b-4628-b456-99b4aab690b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.165259 Aug 04 21:30:55.093846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 377/759] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:54 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:55.933599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-7d25b504-f42c-46f1-a02e-e0b7dad7e3e9 req-60b5bb10-3aa8-4010-b725-32293a4fa5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "name": "network-vif-plugged", "status": "completed", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:30:55.943385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7d25b504-f42c-46f1-a02e-e0b7dad7e3e9 req-60b5bb10-3aa8-4010-b725-32293a4fa5f3 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:55.944392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7d25b504-f42c-46f1-a02e-e0b7dad7e3e9 req-60b5bb10-3aa8-4010-b725-32293a4fa5f3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:55.944855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7d25b504-f42c-46f1-a02e-e0b7dad7e3e9 req-60b5bb10-3aa8-4010-b725-32293a4fa5f3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:55.954764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2bb225a7-13e8-4e74-888a-60d1ccd3a64a tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70d3ddc0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:55.958125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-7d25b504-f42c-46f1-a02e-e0b7dad7e3e9 req-60b5bb10-3aa8-4010-b725-32293a4fa5f3 service nova] Creating event network-vif-plugged:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:30:55.963967 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-7d25b504-f42c-46f1-a02e-e0b7dad7e3e9 req-60b5bb10-3aa8-4010-b725-32293a4fa5f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237379 Aug 04 21:30:55.965056 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 383/760] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:56.014800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2bb225a7-13e8-4e74-888a-60d1ccd3a64a tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/44c253c6-86bd-4b8f-a1a8-f80865d0d442" status: 200 len: 351 microversion: 2.1 time: 0.064001 Aug 04 21:30:56.015838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 378/761] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:30:55 2022] GET /compute/v2.1/os-volumes/44c253c6-86bd-4b8f-a1a8-f80865d0d442 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:56.119063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:56.120110 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:56.133717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:56.134369 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:56.134807 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:56.135534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:56.136167 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:56.136829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:56.302601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:56.312445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:56.314940 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:56.316871 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-dcd71dd6-b124-4e6d-8bb1-2344fc8b892b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.202766 Aug 04 21:30:56.318515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 384/762] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:56 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:57.340967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:57.342240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:57.350181 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:57.350725 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:57.351347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:57.352072 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:57.352527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:57.352954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:57.515189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:57.535169 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:57.537080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:57.538521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d132006f-37bb-4b22-be36-53d753b2adf4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.201774 Aug 04 21:30:57.549922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 379/763] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:57 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:30:57.800022 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-417e72b0-3e45-449c-acf5-acac5f45aeed tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70d55b80>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:57.857334 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-417e72b0-3e45-449c-acf5-acac5f45aeed tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4570cfd6-5370-4dc4-9b21-dde4048f508f" status: 200 len: 349 microversion: 2.1 time: 0.061964 Aug 04 21:30:57.858006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 385/764] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:30:57 2022] GET /compute/v2.1/os-volumes/4570cfd6-5370-4dc4-9b21-dde4048f508f => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:58.566438 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:58.567005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:58.573782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:58.574258 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:58.576274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:58.576274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:58.576274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:58.576557 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:58.750865 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:58.761469 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:58.762974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:58.764178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5bb820a9-3073-40ae-9ab6-592dbae6f94f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.202461 Aug 04 21:30:58.764934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 380/765] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:58 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:30:59.795564 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:59.797076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:30:59.805245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:59.805758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:59.806261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:59.807054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:30:59.807601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:30:59.808159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:30:59.831791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f36a2f63-9659-4bd3-9861-7c88682a53ed tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70d1d310>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:59.894979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f36a2f63-9659-4bd3-9861-7c88682a53ed tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/98412e9c-c7fe-47cf-8b2d-07c92560b4a4" status: 200 len: 351 microversion: 2.1 time: 0.067483 Aug 04 21:30:59.895910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 381/766] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Aug 4 21:30:59 2022] GET /compute/v2.1/os-volumes/98412e9c-c7fe-47cf-8b2d-07c92560b4a4 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:30:59.910386 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-93655994-aa39-4e26-a4f7-8c2058fca980 tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70d3d700>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:30:59.980780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:59.991050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:59.993446 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:30:59.995570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cf9dadfe-89f1-4722-9fe1-dcad8d150d51 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.204770 Aug 04 21:31:00.009306 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 386/767] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:30:59 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:00.022230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-93655994-aa39-4e26-a4f7-8c2058fca980 tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.116530 Aug 04 21:31:00.023068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 382/768] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Aug 4 21:30:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:00.042818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-596a250a-1717-4f9c-8b1c-a3ea6d11d3f2 tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70cdf1f0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.153671 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-596a250a-1717-4f9c-8b1c-a3ea6d11d3f2 tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.115782 Aug 04 21:31:00.154627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 387/769] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:00.170503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7dd8a9b6-2ab3-43af-82df-d8c6a5ae3e58 tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70cf23a0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.272531 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7dd8a9b6-2ab3-43af-82df-d8c6a5ae3e58 tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.108631 Aug 04 21:31:00.273033 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 383/770] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:00.288251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-26bcf960-3532-445a-9df2-7a39fdb63c0a tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70e7a9d0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.379255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-26bcf960-3532-445a-9df2-7a39fdb63c0a tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.097247 Aug 04 21:31:00.379970 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 388/771] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:31:00.396760 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cacf08c0-5055-47ad-bddb-4c9a7dc57bdc tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70d3d700>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.489594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cacf08c0-5055-47ad-bddb-4c9a7dc57bdc tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.098021 Aug 04 21:31:00.490166 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 384/772] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:00.508266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-02117c94-24b5-4947-824c-7cff1aab618c tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70c708b0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.604413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-02117c94-24b5-4947-824c-7cff1aab618c tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.104449 Aug 04 21:31:00.605662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 389/773] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:00.620034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4bfd0933-4db0-4afe-9737-c707cc766d9a tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e70d88040>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.720900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4bfd0933-4db0-4afe-9737-c707cc766d9a tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.105961 Aug 04 21:31:00.721673 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 385/774] 10.222.0.25 () {58 vars in 1188 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:00.737798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a9191dcc-6a51-4733-bfc1-dfb539c7819b tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] Calling method '.version_select at 0x7f8e710b9ca0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:00.841175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a9191dcc-6a51-4733-bfc1-dfb539c7819b tempest-VolumesTestJSON-989786855 tempest-VolumesTestJSON-989786855-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.108118 Aug 04 21:31:00.841804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 390/775] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Aug 4 21:31:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:01.022379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:01.023699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:01.032946 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:01.033775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:01.034442 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:01.035401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:01.036029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:01.036694 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:01.206445 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:01.215282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:01.216821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:01.218039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d2585d52-ca62-4721-a11e-af18706bff80 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.200063 Aug 04 21:31:01.218594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 386/776] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:01 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:02.244071 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:02.244699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:02.253210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:02.253698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:02.254283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:02.254902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:02.257509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:02.257938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:02.379519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:02.380073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:02.386882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:02.387397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:02.387839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:02.389238 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:02.389841 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:02.390487 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:02.429042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8df74776-5508-442c-b788-947413aee775 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/ips" status: 200 len: 147 microversion: 2.1 time: 0.218333 Aug 04 21:31:02.429042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 391/777] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:31:02 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/ips => generated 147 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:02.433935 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:02.444738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:02.446669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:02.448064 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f17eee90-74fd-44bd-8ff0-b04fd4231b56 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.207741 Aug 04 21:31:02.448820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 387/778] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:02 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:31:03.473665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:03.476099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:03.482785 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:03.483791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:03.484337 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:03.485055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:03.486689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:03.487371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:03.683164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:03.698000 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:03.699849 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:03.701174 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e8532864-0c1a-46ff-b6b9-476a94d12af9 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.231737 Aug 04 21:31:03.701832 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 392/779] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:03 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:04.321772 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50d6a9d1-dfa5-4b30-8a11-76e6c55b3791"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:04.324414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:04.332027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:04.332342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:04.333627 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:04.334532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:04.335163 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:04.335625 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:04.734529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:04.735451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:04.753096 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:04.753600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:04.754081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:04.754977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:04.755575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:04.756005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:04.929501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:04.940488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:04.943066 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:04.945468 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b34b506d-229b-4a47-bba5-7d91491e551f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.217447 Aug 04 21:31:04.946256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 393/780] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:04 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:05.271427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-193a248c-4818-4c52-90ae-972f2b0dacef tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.953305 Aug 04 21:31:05.274309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 388/781] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:31:04 2022] POST /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments => generated 194 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:05.970393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:05.970986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:05.977504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:05.977924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:05.978366 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:05.979060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:05.979547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:05.979973 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:06.133218 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:06.141629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:06.143128 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:06.144339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3d4e398e-f8cc-475e-a3ff-5c60f70337c4 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1739 microversion: 2.20 time: 0.178512 Aug 04 21:31:06.144897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 394/782] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:05 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:07.168518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:07.169244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:07.176406 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:07.176892 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:07.177328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:07.178439 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:07.178561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:07.178885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:07.315515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:07.323707 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:07.325241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:07.326396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f21635a2-84f4-4a55-9861-58323207d0f5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1721 microversion: 2.20 time: 0.162890 Aug 04 21:31:07.326944 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 389/783] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:07 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:08.349604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:08.350203 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:08.352926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:08.357762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:08.358266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:08.358695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:08.359408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:08.359899 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:08.360313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:08.508833 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:08.517618 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:08.519168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:08.520347 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-07267eed-88d2-4ac5-9316-3225ab1959ee tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1721 microversion: 2.20 time: 0.174767 Aug 04 21:31:08.520912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 395/784] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:08 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:09.543366 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:09.543973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:09.546480 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:09.551527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:09.552412 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:09.552580 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:09.553954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:09.555046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:09.555718 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:09.700521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:09.710139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:09.711835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:09.713005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7df4f994-4dc1-4ef9-8b3e-6de4da48841c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1724 microversion: 2.20 time: 0.173751 Aug 04 21:31:09.713823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 390/785] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:09 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:09.735633 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdde9987-ee3d-4aa3-8a48-c0a5ca404dae"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:09.738261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:09.744567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:09.745049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:09.745485 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:09.746206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:09.746699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:09.747125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:09.763255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-e2c379b6-a6c4-4b01-8547-c9e0a303cc77 req-2e55d39d-c1ac-4951-995f-db4b39b7b31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "name": "network-vif-unplugged", "status": "completed", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:09.773917 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-e2c379b6-a6c4-4b01-8547-c9e0a303cc77 req-2e55d39d-c1ac-4951-995f-db4b39b7b31c service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:09.774475 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-e2c379b6-a6c4-4b01-8547-c9e0a303cc77 req-2e55d39d-c1ac-4951-995f-db4b39b7b31c service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:09.774973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-e2c379b6-a6c4-4b01-8547-c9e0a303cc77 req-2e55d39d-c1ac-4951-995f-db4b39b7b31c service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:09.788165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-e2c379b6-a6c4-4b01-8547-c9e0a303cc77 req-2e55d39d-c1ac-4951-995f-db4b39b7b31c service nova] Creating event network-vif-unplugged:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:31:09.792523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-e2c379b6-a6c4-4b01-8547-c9e0a303cc77 req-2e55d39d-c1ac-4951-995f-db4b39b7b31c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033270 Aug 04 21:31:09.793236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 391/786] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:31:09.822758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=100 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:10.759573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0af3a206-2625-4903-8e97-f21e26d0ade0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.027955 Aug 04 21:31:10.760248 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 396/787] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Aug 4 21:31:09 2022] POST /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-volume_attachments => generated 188 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 21:31:10.885448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:10.886381 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:10.892781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:10.893255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:10.893683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:10.894370 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:10.894813 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:10.895419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:11.562516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-caa3f942-4f99-4b6f-a54a-e38942149450 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-volume_attachments/cdde9987-ee3d-4aa3-8a48-c0a5ca404dae" status: 202 len: 0 microversion: 2.20 time: 0.681422 Aug 04 21:31:11.563067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 392/788] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Aug 4 21:31:10 2022] DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-volume_attachments/cdde9987-ee3d-4aa3-8a48-c0a5ca404dae => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:31:11.625390 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:11.626053 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:11.632499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:11.632978 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:11.633408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:11.634126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:11.634584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:11.635001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:11.681027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118549) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:31:11.967966 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ff622173-c20c-48e2-8072-b5f9c398151d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "POST /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/action" status: 202 len: 0 microversion: 2.20 time: 0.346621 Aug 04 21:31:11.968698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 397/789] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Aug 4 21:31:11 2022] POST /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:31:11.977230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:11.978438 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:11.985916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:11.986447 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:11.987061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:11.987798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:11.988252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:11.988672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:12.006818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:12.128548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:12.136643 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:12.138123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:12.139253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6fbd7428-c362-4b8f-b59e-3f5ab103317d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1672 microversion: 2.20 time: 0.166445 Aug 04 21:31:12.139990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 393/790] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:11 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:12.912576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:12.914768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:12.920750 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:12.921229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:12.921658 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:12.922340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:12.922812 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:12.923276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:12.956312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8559f3f2-c4c4-44a9-947c-c7e5175982e6 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Aug 04 21:31:12.956828 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 398/791] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:12 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:12.968543 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:12.969122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:12.975934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:12.976385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:12.976814 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:12.977493 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:12.978037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:12.978337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:13.009290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-79aa5fd4-8fcd-4b89-ad4d-09d63ff36636 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/50d6a9d1-dfa5-4b30-8a11-76e6c55b3791" status: 200 len: 194 microversion: 2.1 time: 0.044598 Aug 04 21:31:13.009911 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 394/792] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Aug 4 21:31:12 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/50d6a9d1-dfa5-4b30-8a11-76e6c55b3791 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:31:13.162364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:13.162959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:13.168956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:13.169425 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:13.169847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:13.170517 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:13.170958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:13.171406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:13.312260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:13.320732 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:13.322209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:13.323372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8245cc4b-7011-4e78-87fc-734bba904624 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1672 microversion: 2.20 time: 0.165159 Aug 04 21:31:13.324115 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 399/793] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:13 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:14.349611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:14.350544 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:14.358225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:14.358703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:14.359134 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:14.359841 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:14.360914 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:14.361330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:14.513831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:14.521909 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:14.523702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:14.524873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-28b1ed94-d7a7-4dde-8a1e-20ba5eb1ac91 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.179381 Aug 04 21:31:14.525439 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 395/794] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:14 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:14.687053 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df4447a9-3cc6-46a5-840c-e48aa7cfa944"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:14.689954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:14.697210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:14.697690 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:14.698115 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:14.698801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:14.699445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:14.700178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:15.558791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:15.559413 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:15.568798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:15.569548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:15.570171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:15.571176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:15.571669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:15.572100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:15.629232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-90666b7f-93f6-4b85-b88d-37e8ad09cb02 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "POST /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945475 Aug 04 21:31:15.630282 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 400/795] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:31:14 2022] POST /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:15.746003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:15.754514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:15.756078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:15.757264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1e7951d3-a51e-4d65-800e-802a067474b0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.202447 Aug 04 21:31:15.757831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 396/796] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:15 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:31:16.792301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:16.793917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:16.811106 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:16.811665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:16.812099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:16.818511 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:16.819545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:16.820058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:17.049717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:17.060151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:17.062246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:17.064644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4c6c011a-4c45-4e3a-a254-350ed2f201c7 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.279087 Aug 04 21:31:17.067779 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 401/797] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:16 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:18.089646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:18.090329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:18.097300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:18.097787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:18.098223 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:18.099024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:18.099544 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:18.099967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:18.290171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:18.290171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:18.290550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:18.290550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-69210419-3c26-4803-84f9-7f0586279da5 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.168534 Aug 04 21:31:18.290550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 397/798] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:18 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:19.309036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:19.323363 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:19.349070 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:19.352976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:19.355741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:19.359283 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:19.360602 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:19.362074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:19.539293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:19.548973 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:19.550814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:19.553178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c53b1d1c-04d1-4564-ae24-eef25aa56ca2 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.253721 Aug 04 21:31:19.554684 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 402/799] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:19 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:20.577784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:20.578726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:20.586464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:20.587301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:20.588061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:20.589182 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:20.589719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:20.590197 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:20.759892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:20.760541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:20.771102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:20.771466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:20.781133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:20.781695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:20.784295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:20.784781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:20.785322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:20.788427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:20.792663 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:20.794495 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-39c58f35-5e12-4223-99ab-a235e294227a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.220761 Aug 04 21:31:20.795640 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 398/800] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:20 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:20.839710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-be5ff9a3-57c8-4525-980b-ca6f0e0eefbb tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/ips" status: 200 len: 149 microversion: 2.1 time: 0.083320 Aug 04 21:31:20.846893 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 403/801] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Aug 4 21:31:20 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:31:21.818326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:21.819035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:21.826110 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:21.826681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:21.827494 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:21.835352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:21.835352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:21.835352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:22.300634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:22.309687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:22.311678 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:22.312994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-06a19838-c3cd-4c3d-ae1d-55e1b75d7ed3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.498811 Aug 04 21:31:22.314025 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 399/802] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:21 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:22.658050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69410ae-764e-4de9-824e-337f3a90a8fa"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:22.661463 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:22.667879 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:22.668650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:22.669254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:22.670129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:22.670742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:22.671486 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:23.345051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:23.345761 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:23.359638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:23.360780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:23.361327 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:23.362294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:23.364010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:23.369031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:23.583459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:23.592919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:23.595122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:23.596343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5e55cff9-f17c-4d88-8152-e7082c026b6a tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.262082 Aug 04 21:31:23.607890 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 400/803] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:23 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:31:24.619853 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:24.620489 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:24.626833 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:24.627349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:24.631029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:24.631029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:24.631029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:24.631029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:24.773512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:24.781973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:24.783506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:24.784650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9163c373-3305-40d8-8593-805e7d48a6d0 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.168671 Aug 04 21:31:24.785218 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 401/804] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:24 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:25.809075 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:25.811124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:25.816512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:25.817445 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:25.818312 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:25.819260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:25.820255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:25.820750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:25.868339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f6c30fd9-d99c-4684-8e27-16b45896aa06 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "POST /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.215076 Aug 04 21:31:25.869574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 404/805] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:31:22 2022] POST /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments => generated 194 bytes in 3217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:25.987347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:25.998248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:26.000511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:26.005479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-39110af1-0f63-446e-ac97-13c051d82fae tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.196980 Aug 04 21:31:26.005479 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 402/806] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:25 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:27.027526 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:27.028216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:27.034530 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:27.034972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:27.035442 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:27.036238 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:27.036978 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:27.037231 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:27.174176 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:27.182370 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:27.183883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:27.185020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-073e5a9d-50a0-442c-91f7-eaf66685fc21 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.162319 Aug 04 21:31:27.185568 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 405/807] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:27 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:27.824140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-9bbf4dec-11ca-47d8-b747-6093a82e1202 req-042f3693-d405-40d0-9e9e-f21db8463084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "name": "network-vif-plugged", "status": "completed", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:27.835248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9bbf4dec-11ca-47d8-b747-6093a82e1202 req-042f3693-d405-40d0-9e9e-f21db8463084 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:27.835742 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9bbf4dec-11ca-47d8-b747-6093a82e1202 req-042f3693-d405-40d0-9e9e-f21db8463084 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:27.836161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9bbf4dec-11ca-47d8-b747-6093a82e1202 req-042f3693-d405-40d0-9e9e-f21db8463084 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:27.849454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-9bbf4dec-11ca-47d8-b747-6093a82e1202 req-042f3693-d405-40d0-9e9e-f21db8463084 service nova] Creating event network-vif-plugged:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:31:27.855539 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-9bbf4dec-11ca-47d8-b747-6093a82e1202 req-042f3693-d405-40d0-9e9e-f21db8463084 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034373 Aug 04 21:31:27.855539 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 403/808] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:28.212804 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:28.214948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:28.221723 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:28.222498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:28.222637 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:28.223989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:28.224780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:28.225484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:28.368018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:28.376951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:28.378453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:28.379658 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2ca77c24-e7ce-4c45-978f-bb7a471ab191 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.174215 Aug 04 21:31:28.380237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 406/809] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:28 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:29.404133 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:29.405530 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:29.413210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:29.413701 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:29.414576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:29.415522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:29.415984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:29.416418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:29.563302 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:29.572198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:29.573967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:29.574926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6c7016bb-7c46-4a79-8c48-5a35317b3285 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.175862 Aug 04 21:31:29.579516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 404/810] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:29 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:30.600202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:30.600981 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:30.607704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:30.608184 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:30.608610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:30.609355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:30.609798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:30.610883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:30.626905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:30.775013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:30.784853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:30.786355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:30.787566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6a81d005-d874-44af-b554-2b8c82126e55 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1730 microversion: 2.20 time: 0.191446 Aug 04 21:31:30.788140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 407/811] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:30 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:31.809958 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:31.812648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:31.817533 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:31.818009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:31.818438 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:31.819129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:31.820034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:31.820611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:31.975546 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:31.983979 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:31.985396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:31.986541 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-82d1ef2a-deb6-4468-880c-3db6b9da5cc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1717 microversion: 2.20 time: 0.180542 Aug 04 21:31:31.987096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 405/812] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:31:31 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:31:32.144829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:32.147467 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:32.154060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:32.154544 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:32.155509 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:32.155777 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:32.156151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:32.156605 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:32.189725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8e7c53e1-bc2d-46e3-93fe-1eaea11af2c9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049534 Aug 04 21:31:32.190307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 408/813] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:32 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:32.337474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:32.337960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:32.344027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:32.344507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:32.344938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:32.345628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:32.346124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:32.346541 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:32.381439 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-15892186-ea01-424b-b3e6-70993e94e2a8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/50d6a9d1-dfa5-4b30-8a11-76e6c55b3791" status: 200 len: 194 microversion: 2.1 time: 0.047950 Aug 04 21:31:32.382058 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 406/814] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Aug 4 21:31:32 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/50d6a9d1-dfa5-4b30-8a11-76e6c55b3791 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:32.392989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:32.393482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:32.399399 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:32.399882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:32.400313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:32.401039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:32.401493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:32.401912 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:32.485628 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lazy-loading 'services' on Instance uuid 41e4532c-ce69-433b-89ec-95849524f368 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:32.691291 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-aac7ae96-9b2b-4776-934a-04bc7352f480 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/50d6a9d1-dfa5-4b30-8a11-76e6c55b3791" status: 202 len: 0 microversion: 2.1 time: 0.302599 Aug 04 21:31:32.691974 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 409/815] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:31:32 2022] DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/50d6a9d1-dfa5-4b30-8a11-76e6c55b3791 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:31:36.133322 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:36.133910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:36.140506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:36.140989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:36.142115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:36.142813 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:36.143268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:36.143721 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:36.167960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lazy-loading 'flavor' on Instance uuid 0af22041-6737-4c9b-b8c2-896666da1473 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:36.448869 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-86b4ff22-5ad5-49ec-9eef-0292afcacba3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "POST /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473/action" status: 202 len: 0 microversion: 2.1 time: 0.319279 Aug 04 21:31:36.449657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 407/816] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:31:36 2022] POST /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:31:36.459138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:36.459873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:36.466181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:36.466667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:36.467094 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:36.467811 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:36.468284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:36.468718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:36.624687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:36.633185 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-20a8c792-33e8-4212-afce-3c661656770e tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.179051 Aug 04 21:31:36.633759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 410/817] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:36 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:37.654342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:37.655028 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:37.662209 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:37.662680 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:37.663112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:37.663839 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:37.664289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:37.664711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:37.806662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:37.809196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:37.821126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4ca0039a-e950-4eb6-992f-e51e262e09c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.166831 Aug 04 21:31:37.821126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 408/818] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:37 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:38.840627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:38.841335 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:38.843742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:38.853320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:38.853813 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:38.854253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:38.855099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:38.855590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:38.856085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:38.922982 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:38.939481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:38.939481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:38.939481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:38.939481 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:38.939906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:38.939906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:38.939906 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:39.024171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'services' on Instance uuid e4e2a920-b408-431f-9985-811e1baf27e1 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:39.067343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:39.082863 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f6c8e145-4fa8-47d2-8d86-1899ffbd70a9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.246042 Aug 04 21:31:39.084678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 411/819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:38 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:39.316973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e82ee91c-ee8d-4d45-8681-aff22e117669 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments/e69410ae-764e-4de9-824e-337f3a90a8fa" status: 202 len: 0 microversion: 2.1 time: 0.398018 Aug 04 21:31:39.317571 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 409/820] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:31:38 2022] DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments/e69410ae-764e-4de9-824e-337f3a90a8fa => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:31:39.326293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:39.328627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:39.335710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:39.336201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:39.336625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:39.337321 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:39.337767 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:39.338185 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:39.368882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-dc749f61-8f6c-46f9-944f-e2ed66ad41ba tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Aug 04 21:31:39.369447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 412/821] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:39 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:39.881698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-576872245", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:39.888662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=40 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:39.938247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] validate_networks() for None {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:31:40.106304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:40.107580 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:40.114583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.115057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.115525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.116269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.116747 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.117163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.255114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:31:40.255676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:31:40.256221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:31:40.256634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:31:40.257042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:31:40.266745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.267286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.267768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.268501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.268952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.269372 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.271748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:40.280006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f6546d2e-69f6-47cd-8505-54e4f181d078 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.178041 Aug 04 21:31:40.280606 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 413/822] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:40 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:40.287410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:40.287900 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:40.288348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Getting quotas for project 5603eb09b4be40b98fe3bad6c40680b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:31:40.293298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Getting quotas for user f6a9a76ad8914f28927418359e5a5eee and project 5603eb09b4be40b98fe3bad6c40680b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:31:40.295092 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.295645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.296146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.301561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.301561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.301561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.306429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:31:40.308835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:31:40.328312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9fd5de1f-509e-4f56-87e5-1afbdb5dbe6e tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/df4447a9-3cc6-46a5-840c-e48aa7cfa944" status: 200 len: 194 microversion: 2.1 time: 0.046404 Aug 04 21:31:40.329458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 414/823] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Aug 4 21:31:40 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/df4447a9-3cc6-46a5-840c-e48aa7cfa944 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:40.340005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:40.340488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:40.347730 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.348213 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.348649 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.349333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.349781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.350206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.436634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lazy-loading 'services' on Instance uuid 41e4532c-ce69-433b-89ec-95849524f368 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:40.473634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1b27d584-9734-4a13-9f20-6f4cf2df4e4f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596101 Aug 04 21:31:40.480278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 410/824] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:31:40.480278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:40.482709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:40.490343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.490833 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.491988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.492817 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:40.493279 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:40.493708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:40.525213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3ca759cd-9d47-4170-b23e-d6059ffb98e3 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049889 Aug 04 21:31:40.529976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 411/825] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:40 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:40.530624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-56560b0a-c42a-4668-a786-6dd8a38ed479 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:40.531222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-56560b0a-c42a-4668-a786-6dd8a38ed479 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:40.589896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-56560b0a-c42a-4668-a786-6dd8a38ed479 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:40.597451 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-56560b0a-c42a-4668-a786-6dd8a38ed479 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1214 microversion: 2.1 time: 0.069337 Aug 04 21:31:40.597451 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 412/826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:40 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:40.691213 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9317a961-96bf-4d89-a328-dbe6e286e638 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/df4447a9-3cc6-46a5-840c-e48aa7cfa944" status: 202 len: 0 microversion: 2.1 time: 0.355024 Aug 04 21:31:40.692124 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 415/827] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:31:40 2022] DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments/df4447a9-3cc6-46a5-840c-e48aa7cfa944 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:31:41.304267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:41.305470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:41.314632 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.315019 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.315503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.316210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.316655 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.317077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.468084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:41.476685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a46aadef-be2d-4e76-a02a-b400f2c7742a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.177087 Aug 04 21:31:41.477238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 413/828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:41 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:41.540293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:41.542843 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:41.550150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.550636 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.551131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.551801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.552258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.552679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.585564 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-60e97dba-a9fe-4039-bb50-19f3cf2962ca tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050354 Aug 04 21:31:41.586004 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 416/829] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:41 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:31:41.617421 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f57c033a-2454-45be-b485-2d22ab718df0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:41.618077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f57c033a-2454-45be-b485-2d22ab718df0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:41.658287 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:41.658792 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:41.665961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.666206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.666645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.667495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.668087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.668250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.678037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f57c033a-2454-45be-b485-2d22ab718df0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:41.686687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f57c033a-2454-45be-b485-2d22ab718df0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1214 microversion: 2.1 time: 0.072552 Aug 04 21:31:41.687699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 414/830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:41 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:41.703206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:31:41.895053 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:41.897392 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:41.908605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.909407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.910149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.911380 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:41.912196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:41.912826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:41.950313 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-35bdefe7-a6ed-48e7-bab7-65c2cb69f136 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064728 Aug 04 21:31:41.950904 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 415/831] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:41 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 21:31:42.085782 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7db91e94-1d24-48e2-9024-64f9b89c327c tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 204 len: 0 microversion: 2.1 time: 0.431716 Aug 04 21:31:42.086637 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 417/832] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:41 2022] DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:31:42.102009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:42.102912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:42.109631 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.110144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.110571 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.111305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.111879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.112388 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.116367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:42.119337 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:42.127153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.127694 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.128135 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.128838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.129288 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.129764 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.167643 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-39fbfe15-e5ef-4e42-a43e-47274b0a5142 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059160 Aug 04 21:31:42.168140 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 418/833] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:31:42 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:31:42.248508 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:42.249005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:42.256116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.256603 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.257044 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.257756 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.258211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.258630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.269501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:42.277572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-700f2a4a-4619-4c21-b341-dab4e56a3ab9 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1681 microversion: 2.1 time: 0.179818 Aug 04 21:31:42.278293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 416/834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:42 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:42.286072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:31:42.432988 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:42.498056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:42.498950 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:42.506352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.506902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.507250 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.507957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.508416 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.508815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.637130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4294302d-da60-4bf0-b4b4-a01f235ccc19 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 204 len: 0 microversion: 2.1 time: 0.392571 Aug 04 21:31:42.637817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 419/835] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:42 2022] DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:31:42.647032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:42.647766 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:42.656979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.657479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.657911 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.658624 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.659073 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.659695 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.661671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:42.671784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-740fc8cb-a93d-4e4f-a906-31c48a6be5f7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.177460 Aug 04 21:31:42.673056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 417/836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:42 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:42.710326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:42.710849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:42.718547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.719024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.720021 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.720711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:42.721155 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:42.721565 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:42.790424 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:42.804233 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-54927de4-17ff-4b4e-9e2d-9ed88db83663 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1210 microversion: 2.1 time: 0.097673 Aug 04 21:31:42.805343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 418/837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:42 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:42.822836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:42.830504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a093ca7d-4bc9-4a34-9046-daadff063164 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1674 microversion: 2.1 time: 0.187748 Aug 04 21:31:42.831067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 420/838] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:42 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:43.300484 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:43.301122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:43.307091 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.307595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.308031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.308717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.309165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.309585 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.444246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:43.452143 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2d40585d-740a-42d0-a4b7-ffdba76770d7 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1681 microversion: 2.1 time: 0.155622 Aug 04 21:31:43.452716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 419/839] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:43 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:43.694946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:43.695578 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:43.702098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.702579 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.703010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.704472 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.704924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.705343 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.834413 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:43.835749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:43.842826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.842985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:43.843303 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.843780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.844525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.844960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.845373 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.852874 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c5e9777f-102e-4c22-8f10-085ddfc91c49 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.162037 Aug 04 21:31:43.853706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 421/840] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:43 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:43.858081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:43.874104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:43.874104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.874104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.874104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.874500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:43.874500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:43.874500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:43.916257 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:43.924931 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7d10a81e-139c-4256-911f-8181c61372e5 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1266 microversion: 2.1 time: 0.095381 Aug 04 21:31:43.925673 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 420/841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:43 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:44.004609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:44.012464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7edb63d5-fd07-482e-9070-91db1f19f3de tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1674 microversion: 2.1 time: 0.158015 Aug 04 21:31:44.013254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 422/842] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:43 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:44.473793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:44.474693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:44.480703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:44.481186 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:44.481623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:44.482318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:44.482770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:44.483186 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:44.658691 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:44.669557 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e3e1bee0-e414-4a86-b571-dfa2c516c083 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1681 microversion: 2.1 time: 0.200077 Aug 04 21:31:44.670213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 421/843] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:44 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:44.874091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:44.874705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:44.881493 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:44.881979 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:44.882408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:44.883112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:44.883612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:44.884020 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:44.946977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:44.947656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:44.955524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:44.956106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:44.956544 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:44.957247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:44.957702 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:44.958275 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:45.024846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:45.036011 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5626ea1e-919f-424a-b31d-84b7f16cb50f tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1266 microversion: 2.1 time: 0.093031 Aug 04 21:31:45.036884 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 422/844] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:44 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:45.037646 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:45.041739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:45.042526 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:45.046350 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d20b7671-3cb5-4143-acee-a96793dbfe21 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.176044 Aug 04 21:31:45.048382 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 423/845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:44 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:45.048791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:45.049394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:45.055503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:45.055503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:45.055503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:45.055503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:45.189253 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:45.197498 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-07bbf550-5436-4d78-a90c-b872da93785a tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1674 microversion: 2.1 time: 0.159522 Aug 04 21:31:45.198065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 423/846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:45 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:45.695876 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:45.696499 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:45.711514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:45.712956 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:45.713406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:45.714197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:45.714648 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:45.715364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.010195 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:46.021392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8a4b6f05-52b4-4006-adf4-1b755d72f1b6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1681 microversion: 2.1 time: 0.330084 Aug 04 21:31:46.024059 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 424/847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:45 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:46.056776 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:46.057374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:46.065239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:46.065722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:46.066330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.072644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:46.073254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:46.075637 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:46.076125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:46.076558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.086159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:46.086634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:46.087068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.087797 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:46.088263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:46.088681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.381766 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:46.391885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c6d538ad-8d38-4af5-abb0-6c741c77cd58 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1274 microversion: 2.1 time: 0.338038 Aug 04 21:31:46.405960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 424/848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:46 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:46.412166 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:46.413001 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:46.421892 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:46.422391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:46.422823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.423636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:46.424722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:46.424722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:46.550069 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:46.571891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-99d529fe-ed58-48bb-8792-8c0d62f3c7c4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.489815 Aug 04 21:31:46.572541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 425/849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:46 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:46.646828 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:46.654893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-24a793e7-7459-4cf3-bb42-485820e27166 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1674 microversion: 2.1 time: 0.246929 Aug 04 21:31:46.655590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 425/850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:46 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1674 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:47.048178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:47.049507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:47.056592 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.057357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.057781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.058655 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.059256 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.060028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.170086 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:47.190109 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-33658ead-953b-4285-ad0b-0616b01b7f3b tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1613 microversion: 2.1 time: 0.146264 Aug 04 21:31:47.190704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 426/851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:47 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:47.202990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-7606329a-7a27-4a81-b068-aeecd9643098 req-cd24a438-7059-4738-a527-e1164cf7873b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4e2a920-b408-431f-9985-811e1baf27e1", "name": "network-vif-deleted", "tag": "11484221-608a-4c80-8cfc-6c37d7c9b9d0"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:47.237108 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-7606329a-7a27-4a81-b068-aeecd9643098 req-cd24a438-7059-4738-a527-e1164cf7873b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.237592 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-7606329a-7a27-4a81-b068-aeecd9643098 req-cd24a438-7059-4738-a527-e1164cf7873b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.238082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-7606329a-7a27-4a81-b068-aeecd9643098 req-cd24a438-7059-4738-a527-e1164cf7873b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.255083 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-7606329a-7a27-4a81-b068-aeecd9643098 req-cd24a438-7059-4738-a527-e1164cf7873b service nova] Creating event network-vif-deleted:11484221-608a-4c80-8cfc-6c37d7c9b9d0 for instance e4e2a920-b408-431f-9985-811e1baf27e1 on hv-cinder-85220 Aug 04 21:31:47.260711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-7606329a-7a27-4a81-b068-aeecd9643098 req-cd24a438-7059-4738-a527-e1164cf7873b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061209 Aug 04 21:31:47.262403 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 426/852] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:47.414226 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:47.415098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:47.421525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.422825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.423486 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.424360 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.424983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.425663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.560321 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:47.574408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-35fdf434-1efe-40c7-acfb-f3da3a1d11b0 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1272 microversion: 2.1 time: 0.161867 Aug 04 21:31:47.583309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:47.584286 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:47.590100 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 427/853] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:47 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:47.605484 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.606270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.606893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.607824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.608436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.609043 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.676491 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:47.677106 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:47.699055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.699968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.700643 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.701531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.702180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.702762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.842536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:47.858558 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d4dacf88-5a10-4cd7-a25b-f1331c8f49cc tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1322 microversion: 2.1 time: 0.186041 Aug 04 21:31:47.859574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 428/854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:47 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:47.866279 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:47.872955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-420bda25-eb5d-45e6-92d6-168d236e9728 req-404b623b-8613-4346-9881-7b289c46444e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e4532c-ce69-433b-89ec-95849524f368", "name": "network-vif-deleted", "tag": "5bc8673d-456c-4d4c-adfa-86e534e52cbb"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:47.874936 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-cb24626e-da49-465e-9387-c321cfc558ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.296401 Aug 04 21:31:47.879036 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 427/855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:47 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:47.890597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-420bda25-eb5d-45e6-92d6-168d236e9728 req-404b623b-8613-4346-9881-7b289c46444e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:47.890597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-420bda25-eb5d-45e6-92d6-168d236e9728 req-404b623b-8613-4346-9881-7b289c46444e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:47.892340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-420bda25-eb5d-45e6-92d6-168d236e9728 req-404b623b-8613-4346-9881-7b289c46444e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:47.906557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-420bda25-eb5d-45e6-92d6-168d236e9728 req-404b623b-8613-4346-9881-7b289c46444e service nova] Creating event network-vif-deleted:5bc8673d-456c-4d4c-adfa-86e534e52cbb for instance 41e4532c-ce69-433b-89ec-95849524f368 on hv-cinder-85220 Aug 04 21:31:47.914635 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-420bda25-eb5d-45e6-92d6-168d236e9728 req-404b623b-8613-4346-9881-7b289c46444e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053252 Aug 04 21:31:47.915666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 429/856] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:48.219991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:48.222031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:48.234522 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.235858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.236539 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.237429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.238048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.238680 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.243650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:48.295263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.295786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.296226 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.307986 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'fault' on Instance uuid e4e2a920-b408-431f-9985-811e1baf27e1 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:48.361075 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:48.372902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4ae396df-62c8-4564-8dce-e4a894dcfe7a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1331 microversion: 2.1 time: 0.162247 Aug 04 21:31:48.374117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 428/857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:48 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:48.597639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:48.598887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:48.605744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.606226 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.606657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.607403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.607858 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.608279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.774422 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:48.788675 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f9e15835-49d4-47ba-952d-956e40e1913c tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1314 microversion: 2.1 time: 0.192391 Aug 04 21:31:48.789430 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 430/858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:48 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:48.893003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:48.898813 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:48.899431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:48.900362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:48.901711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.902410 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.903031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.903768 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.904222 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.904648 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.913262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.913751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.914177 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.914870 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.915748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.916322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.943041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:48.943585 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:48.944042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:48.944485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lazy-loading 'fault' on Instance uuid 41e4532c-ce69-433b-89ec-95849524f368 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:48.989957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b29c3f2c29d4e2aba552c144cff94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00814c2455be4608b2984adcf6353df2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:48.999014 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e9a934a6-460f-4536-b1a9-168531f8c87b tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 200 len: 1327 microversion: 2.1 time: 0.110651 Aug 04 21:31:49.000333 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 429/859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:48 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:49.174890 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:49.183590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-df39d8b7-8921-4ff3-8ef8-70f3ce0e8e7f tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.288885 Aug 04 21:31:49.184505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 431/860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:48 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:49.397730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:49.398375 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:49.404980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:49.405465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:49.405898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:49.407675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:49.408130 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:49.408722 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:49.443949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:49.444448 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:49.445148 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:49.445590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lazy-loading 'fault' on Instance uuid e4e2a920-b408-431f-9985-811e1baf27e1 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:49.487366 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f8480bc7d44f6a51e4a1d875a1c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f28e5935db5c4be4871d727e1958424b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:49.495593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9a2b0a75-bb69-4241-83b0-5f82d8e155e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 200 len: 1331 microversion: 2.1 time: 0.102033 Aug 04 21:31:49.499254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 430/861] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:49 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:49.799594 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-8690e642-356d-499b-8ce6-e5e6acb01f99 req-2431b1cd-22e3-4798-97ef-4ebbefdaa445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1850b659-92cb-469a-a250-29fc7fece53e", "tag": "0184f180-cfcc-4202-9924-a1fba30904aa"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:49.816713 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:49.817328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:49.822702 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8690e642-356d-499b-8ce6-e5e6acb01f99 req-2431b1cd-22e3-4798-97ef-4ebbefdaa445 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:49.823181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8690e642-356d-499b-8ce6-e5e6acb01f99 req-2431b1cd-22e3-4798-97ef-4ebbefdaa445 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:49.823635 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8690e642-356d-499b-8ce6-e5e6acb01f99 req-2431b1cd-22e3-4798-97ef-4ebbefdaa445 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:49.832205 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:49.833017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:49.833404 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:49.834260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:49.834888 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:49.835367 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:49.859249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-8690e642-356d-499b-8ce6-e5e6acb01f99 req-2431b1cd-22e3-4798-97ef-4ebbefdaa445 service nova] Creating event network-changed:0184f180-cfcc-4202-9924-a1fba30904aa for instance 1850b659-92cb-469a-a250-29fc7fece53e on hv-cinder-85220 Aug 04 21:31:49.868079 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-8690e642-356d-499b-8ce6-e5e6acb01f99 req-2431b1cd-22e3-4798-97ef-4ebbefdaa445 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072146 Aug 04 21:31:49.869017 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 432/862] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:50.007229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:50.019113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4de7b0ea-1780-4441-80ef-1f9c2b65b468 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1314 microversion: 2.1 time: 0.207033 Aug 04 21:31:50.025141 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:50.026013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:50.037539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:50.037539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:50.037539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:50.037924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 431/863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:49 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:50.038054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:50.038054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:50.038054 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:50.052182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] HTTP exception thrown: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Request method failure captured: Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 HTTP/1.1 Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlEWF7jM3QtRxC8gbdyszJRAr7zUYiHCXdB1WXsW3RhxF-KIB8TDbinHwo_glhlY7JvDLY9eGy5CPzxdCnu68QPuOLqA9CaMnxdL7-ETvoNmtvhrCS14f-siauZvxwTDXC_-lhMkDKBszdp5U7d75EUcfqw2-QhBeHFLI5v0qNSgrA Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:50.053873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00814c2455be4608b2984adcf6353df2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00814c2455be4608b2984adcf6353df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 9b29c3f2c29d4e2aba552c144cff94f8 Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:50.055565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '41e4532c-ce69-433b-89ec-95849524f368'} Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:50.056507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:50.057948 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.059622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Returning 404 to user: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:50.059622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-81b36f29-5348-4690-9899-0114e450ee78 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 404 len: 111 microversion: 2.1 time: 0.035885 Aug 04 21:31:50.059622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 433/864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:50 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:31:50.065362 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9414ae3d-f4f1-42e4-a853-a1c029d18aeb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '.version_select at 0x7f8e70ce4670>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:50.153769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9414ae3d-f4f1-42e4-a853-a1c029d18aeb tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419165455" status: 202 len: 0 microversion: 2.1 time: 0.092266 Aug 04 21:31:50.154635 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 432/865] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Aug 4 21:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419165455 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:31:50.210375 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:50.210909 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:50.217847 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:50.222861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:50.222861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:50.222861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:50.222861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:50.223428 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:50.398583 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:50.406268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-63433e24-b213-4788-88b6-dd5caae42470 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.201261 Aug 04 21:31:50.407371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 434/866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:50 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:50.514464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:50.519085 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:50.519981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:50.526056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:50.526550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:50.527045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:50.527777 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:50.528228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:50.528654 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:50.544246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 HTTP/1.1 Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:50.546239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:50.548358 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'e4e2a920-b408-431f-9985-811e1baf27e1'} Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:50.552647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:50.554113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:50.558920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:50.558920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6eb5fdad-e107-4b4e-bce1-834ba6aeb6e6 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 404 len: 111 microversion: 2.1 time: 0.034060 Aug 04 21:31:50.558920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 433/867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:50 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:50.559160 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0aeeee13-5598-4848-b2cc-88e580bcfbc2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '.version_select at 0x7f8e70c934c0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:50.638390 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0aeeee13-5598-4848-b2cc-88e580bcfbc2 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292843009" status: 202 len: 0 microversion: 2.1 time: 0.084079 Aug 04 21:31:50.639239 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 435/868] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Aug 4 21:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292843009 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:31:51.040628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:51.040628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:51.046632 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.047124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.047588 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.048278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.048721 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.049140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.206330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:51.213719 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0baa5c87-0e73-4003-97ff-3f532f88155a tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1314 microversion: 2.1 time: 0.178871 Aug 04 21:31:51.214292 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 434/869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:51 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:51.430582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:51.433704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:51.439986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.440462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.440898 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.441773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.442221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.442958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.751055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:51.762278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2e376bf6-7db1-434c-b9fb-63961d429e74 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1568 microversion: 2.1 time: 0.336138 Aug 04 21:31:51.763818 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 436/870] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:51 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:51.791951 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:51.792727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:51.795199 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=10 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:51.802080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.802666 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.803392 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.804318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.804973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.805398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.835658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118550) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 21:31:51.953545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-317cc066-0c9c-446b-bc4d-3045331e8d8b req-575c6f6f-4cfc-4bad-bfbf-9b25a2911a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "name": "network-vif-unplugged", "status": "completed", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:51.963829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-317cc066-0c9c-446b-bc4d-3045331e8d8b req-575c6f6f-4cfc-4bad-bfbf-9b25a2911a9d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:51.964729 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-317cc066-0c9c-446b-bc4d-3045331e8d8b req-575c6f6f-4cfc-4bad-bfbf-9b25a2911a9d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:51.965401 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-317cc066-0c9c-446b-bc4d-3045331e8d8b req-575c6f6f-4cfc-4bad-bfbf-9b25a2911a9d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:51.991661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.compute.server_external_events [req-317cc066-0c9c-446b-bc4d-3045331e8d8b req-575c6f6f-4cfc-4bad-bfbf-9b25a2911a9d service nova] Unable to find a host for instance 0af22041-6737-4c9b-b8c2-896666da1473. Dropping event network-vif-unplugged {{(pid=118549) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 21:31:51.991661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-317cc066-0c9c-446b-bc4d-3045331e8d8b req-575c6f6f-4cfc-4bad-bfbf-9b25a2911a9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036265 Aug 04 21:31:51.991661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 437/871] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 21:31:52.234230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:52.235057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:52.242149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:52.243611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:52.243611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:52.244284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:52.244982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:52.245403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:52.250634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5575022e-cc21-412b-9cd5-4b6900ed5e4a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "POST /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473/action" status: 202 len: 0 microversion: 2.1 time: 0.462344 Aug 04 21:31:52.253401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 435/872] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:31:51 2022] POST /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:31:52.261995 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:52.262985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:52.271681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:52.277823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:52.277823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:52.277823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:52.277823 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:52.281596 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:52.484183 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:52.484424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:52.495533 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2d237e58-2434-42de-ab56-bfc70a6590af tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1516 microversion: 2.1 time: 0.237564 Aug 04 21:31:52.499408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f8965ca9-1fc1-42f5-9ec3-d4fd2231b72e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1314 microversion: 2.1 time: 0.268678 Aug 04 21:31:52.500001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 438/873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:52 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:52.509981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 436/874] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:52 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:53.119798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:53.120399 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:53.126665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.127147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.127612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.128339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.128800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.129202 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.144247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 HTTP/1.1 Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:53.145869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.147410 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'e4e2a920-b408-431f-9985-811e1baf27e1'} Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:53.148348 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.149760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.151196 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:53.151196 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ec814d41-d590-4a62-86f8-56f424e91c09 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 404 len: 111 microversion: 2.1 time: 0.031470 Aug 04 21:31:53.151196 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 439/875] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:53 2022] DELETE /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:53.161837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:53.162477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: e4e2a920-b408-431f-9985-811e1baf27e1] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:53.169012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.169489 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.169918 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.170615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.171063 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.171515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.185396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 HTTP/1.1 Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:53.187012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.189217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'e4e2a920-b408-431f-9985-811e1baf27e1'} Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:53.190100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. Aug 04 21:31:53.191668 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.193414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance e4e2a920-b408-431f-9985-811e1baf27e1 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:53.193414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7d025bff-fd21-4e72-9b4f-ac15466a7c36 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1" status: 404 len: 111 microversion: 2.1 time: 0.030977 Aug 04 21:31:53.193414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 437/876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:53 2022] GET /compute/v2.1/servers/e4e2a920-b408-431f-9985-811e1baf27e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:53.517907 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:53.518514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:53.522817 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:53.523474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:53.525232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.525708 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.526211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.526955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.527445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.527864 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.529727 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.530352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.530846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.531696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.532308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.532910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.545229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:53.674357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:53.685945 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:53.691647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-245ce9a4-ff35-4577-9189-d32613c3cf35 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1516 microversion: 2.1 time: 0.169130 Aug 04 21:31:53.691647 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 440/877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:53 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:53.696012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-bae078dd-cde8-4724-9f91-4609515b3ee3 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1314 microversion: 2.1 time: 0.177095 Aug 04 21:31:53.696570 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 438/878] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:53 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:31:53.811192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:53.811819 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:53.818931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.819448 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.820186 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.823512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.823512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.823512 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.835276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] HTTP exception thrown: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Request method failure captured: Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 HTTP/1.1 Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlEWF7jM3QtRxC8gbdyszJRAr7zUYiHCXdB1WXsW3RhxF-KIB8TDbinHwo_glhlY7JvDLY9eGy5CPzxdCnu68QPuOLqA9CaMnxdL7-ETvoNmtvhrCS14f-siauZvxwTDXC_-lhMkDKBszdp5U7d75EUcfqw2-QhBeHFLI5v0qNSgrA Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:53.836853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00814c2455be4608b2984adcf6353df2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00814c2455be4608b2984adcf6353df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 9b29c3f2c29d4e2aba552c144cff94f8 Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.838163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '41e4532c-ce69-433b-89ec-95849524f368'} Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:53.839116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.840758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.842149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Returning 404 to user: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:53.842149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f6efd98a-9e54-4bfe-9921-da1c788f66e9 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 04 21:31:53.842149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 441/879] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:53 2022] DELETE /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:53.847294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:53.847940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: 41e4532c-ce69-433b-89ec-95849524f368] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:53.854010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.854490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.854920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.857984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:53.857984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:53.857984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:53.872767 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] HTTP exception thrown: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Request method failure captured: Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 HTTP/1.1 Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlEWF7jM3QtRxC8gbdyszJRAr7zUYiHCXdB1WXsW3RhxF-KIB8TDbinHwo_glhlY7JvDLY9eGy5CPzxdCnu68QPuOLqA9CaMnxdL7-ETvoNmtvhrCS14f-siauZvxwTDXC_-lhMkDKBszdp5U7d75EUcfqw2-QhBeHFLI5v0qNSgrA Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:53.874290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00814c2455be4608b2984adcf6353df2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00814c2455be4608b2984adcf6353df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 9b29c3f2c29d4e2aba552c144cff94f8 Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.876734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '41e4532c-ce69-433b-89ec-95849524f368'} Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:53.877644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. Aug 04 21:31:53.879243 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:53.881741 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Returning 404 to user: Instance 41e4532c-ce69-433b-89ec-95849524f368 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:53.881741 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-159ca2b5-3b21-4ae3-b7ce-a36346c61f50 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368" status: 404 len: 111 microversion: 2.1 time: 0.033008 Aug 04 21:31:53.881741 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 439/880] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:53 2022] GET /compute/v2.1/servers/41e4532c-ce69-433b-89ec-95849524f368 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:54.010807 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-866c40bc-e057-4037-b180-d1286305dbd2 req-8dd41c07-2f60-4fcf-bb9c-4f5c23c5b842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1850b659-92cb-469a-a250-29fc7fece53e", "name": "network-vif-plugged", "status": "completed", "tag": "0184f180-cfcc-4202-9924-a1fba30904aa"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:54.020349 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-866c40bc-e057-4037-b180-d1286305dbd2 req-8dd41c07-2f60-4fcf-bb9c-4f5c23c5b842 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.020815 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-866c40bc-e057-4037-b180-d1286305dbd2 req-8dd41c07-2f60-4fcf-bb9c-4f5c23c5b842 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.021242 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-866c40bc-e057-4037-b180-d1286305dbd2 req-8dd41c07-2f60-4fcf-bb9c-4f5c23c5b842 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.033501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-866c40bc-e057-4037-b180-d1286305dbd2 req-8dd41c07-2f60-4fcf-bb9c-4f5c23c5b842 service nova] Creating event network-vif-plugged:0184f180-cfcc-4202-9924-a1fba30904aa for instance 1850b659-92cb-469a-a250-29fc7fece53e on hv-cinder-85220 Aug 04 21:31:54.038413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-866c40bc-e057-4037-b180-d1286305dbd2 req-8dd41c07-2f60-4fcf-bb9c-4f5c23c5b842 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031216 Aug 04 21:31:54.039431 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 442/881] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:31:54.537754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:54.538324 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:54.544788 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.545983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.545983 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.546495 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.546952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.547419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.560967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 HTTP/1.1 Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:54.562587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.564189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '44f83e2f-66f7-470f-9782-5d9f3d4227c8'} Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:54.565194 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.566797 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.570563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:54.570563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-582261d6-42f3-4dca-9512-f5206542fe0a tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 404 len: 111 microversion: 2.1 time: 0.030436 Aug 04 21:31:54.570563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 440/882] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:54 2022] DELETE /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:54.574207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:54.574885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 44f83e2f-66f7-470f-9782-5d9f3d4227c8] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:54.581960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.582462 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.582923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.583640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.584096 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.584518 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.598919 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 HTTP/1.1 Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:54.600709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.601998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '44f83e2f-66f7-470f-9782-5d9f3d4227c8'} Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:54.602791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. Aug 04 21:31:54.604055 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.605135 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance 44f83e2f-66f7-470f-9782-5d9f3d4227c8 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:54.605135 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-be537ef6-bacb-4673-9ad8-b87cab353026 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8" status: 404 len: 111 microversion: 2.1 time: 0.033001 Aug 04 21:31:54.605135 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 443/883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:54 2022] GET /compute/v2.1/servers/44f83e2f-66f7-470f-9782-5d9f3d4227c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:54.610732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:54.611232 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:54.617298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.617786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.618225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.618916 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.619399 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.619822 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.632922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: DELETE /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 HTTP/1.1 Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:54.634473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.636132 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '11110c93-a770-4efa-baa5-8fa3eb3290b4'} Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:54.636856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.638129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.639378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:54.639378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-be86be77-21dc-4166-a5b9-e00d99a74fcc tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 404 len: 111 microversion: 2.1 time: 0.028986 Aug 04 21:31:54.639378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 441/884] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:54 2022] DELETE /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:54.645433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:54.646070 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: 11110c93-a770-4efa-baa5-8fa3eb3290b4] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:54.652360 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.652923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.653281 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.654019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.654472 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.654892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 HTTP/1.1 Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:54.672298 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.676770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '11110c93-a770-4efa-baa5-8fa3eb3290b4'} Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:54.678403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. Aug 04 21:31:54.682990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:54.684908 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance 11110c93-a770-4efa-baa5-8fa3eb3290b4 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:54.684908 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1abcbf76-8d37-46eb-a884-950029e949ef tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4" status: 404 len: 111 microversion: 2.1 time: 0.031739 Aug 04 21:31:54.684908 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 444/885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:54 2022] GET /compute/v2.1/servers/11110c93-a770-4efa-baa5-8fa3eb3290b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:54.712238 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:54.712842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:54.720925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.720925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.721566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.722282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.722736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.725301 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:54.725743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.726009 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:54.732287 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.732777 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.733210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.733903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:54.734359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:54.734778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:54.892184 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:54.899838 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-89dac413-242f-4b1b-8c7f-e984c8fe3411 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1314 microversion: 2.1 time: 0.182719 Aug 04 21:31:54.900455 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 445/886] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:54 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:54.901501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:54.909761 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c93ca7f1-1128-47d4-b927-62101c2d5d92 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1518 microversion: 2.1 time: 0.201126 Aug 04 21:31:54.910709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 442/887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:54 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:55.263651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:55.264099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:55.271170 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.271717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.272197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.272893 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.273350 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.273775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.288293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] HTTP exception thrown: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Request method failure captured: Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c HTTP/1.1 Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DlEWF7jM3QtRxC8gbdyszJRAr7zUYiHCXdB1WXsW3RhxF-KIB8TDbinHwo_glhlY7JvDLY9eGy5CPzxdCnu68QPuOLqA9CaMnxdL7-ETvoNmtvhrCS14f-siauZvxwTDXC_-lhMkDKBszdp5U7d75EUcfqw2-QhBeHFLI5v0qNSgrA Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:55.289959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00814c2455be4608b2984adcf6353df2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00814c2455be4608b2984adcf6353df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 9b29c3f2c29d4e2aba552c144cff94f8 Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.291629 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'ebc8c40e-8238-4a1b-881e-1c681861109c'} Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:55.292413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.293610 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.294886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Returning 404 to user: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:55.294886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d462e26b-5230-4eb2-b7fd-68b0cd4b0bf8 tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 404 len: 111 microversion: 2.1 time: 0.031898 Aug 04 21:31:55.294886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 446/888] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:55 2022] DELETE /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:55.301430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:55.302129 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] [instance: ebc8c40e-8238-4a1b-881e-1c681861109c] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:55.308553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.309608 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.310010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.310713 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.311309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.311753 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.326586 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] HTTP exception thrown: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Request method failure captured: Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c HTTP/1.1 Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DlEWF7jM3QtRxC8gbdyszJRAr7zUYiHCXdB1WXsW3RhxF-KIB8TDbinHwo_glhlY7JvDLY9eGy5CPzxdCnu68QPuOLqA9CaMnxdL7-ETvoNmtvhrCS14f-siauZvxwTDXC_-lhMkDKBszdp5U7d75EUcfqw2-QhBeHFLI5v0qNSgrA Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:55.328154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00814c2455be4608b2984adcf6353df2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00814c2455be4608b2984adcf6353df2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00814c2455be4608b2984adcf6353df2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 00814c2455be4608b2984adcf6353df2 Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1386641631 Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 9b29c3f2c29d4e2aba552c144cff94f8 Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeTestJSON-1386641631-project Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.329913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'ebc8c40e-8238-4a1b-881e-1c681861109c'} Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:55.330932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. Aug 04 21:31:55.333638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:55.334955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] Returning 404 to user: Instance ebc8c40e-8238-4a1b-881e-1c681861109c could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:55.334955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-541566d4-c1a4-4b65-8cc8-76a6b6a52c7d tempest-AttachVolumeTestJSON-1386641631 tempest-AttachVolumeTestJSON-1386641631-project] 10.222.0.25 "GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c" status: 404 len: 111 microversion: 2.1 time: 0.033411 Aug 04 21:31:55.334955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 443/889] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:55 2022] GET /compute/v2.1/servers/ebc8c40e-8238-4a1b-881e-1c681861109c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:55.921284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:55.921923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:55.928685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.928937 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.929371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.930067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.930513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.930931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.938044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:55.938658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:55.942490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:55.946435 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.946921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.947440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:55.948189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:55.948837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:55.950056 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.092604 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:56.102565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-10950633-640b-460b-931e-faf04c2974fd tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1463 microversion: 2.1 time: 0.185633 Aug 04 21:31:56.103168 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 447/890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:55 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1463 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:56.115217 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:56.115931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:56.122834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.123568 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.124189 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.125169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.125700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.126259 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a HTTP/1.1 Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:31:56.146093 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.150570 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'cb24b55d-a68c-42ce-b470-6e1ed385c48a'} Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:56.151460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.152903 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.154681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:56.154681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-70689950-7916-4c25-8fb6-9b62247eab68 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 404 len: 111 microversion: 2.1 time: 0.034549 Aug 04 21:31:56.154681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 448/891] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:56 2022] DELETE /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:56.154681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:56.154681 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:56.158929 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.159449 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.159884 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.160589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.161404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.161868 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.189290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:31:56.452179 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:56.461313 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b0e84c1f-d329-4fc5-b8ef-fbe96d0cec79 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.527207 Aug 04 21:31:56.461868 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 444/892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:55 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:56.466769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:56.468334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] [instance: cb24b55d-a68c-42ce-b470-6e1ed385c48a] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:56.474737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.475675 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.476383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.477266 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.477816 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.478449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.495842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] HTTP exception thrown: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Request method failure captured: Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a HTTP/1.1 Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk-KeWf8SvMjYED6djGSoB97cSk4_bfbPbQBT4K4-v7AkCVP0QeSIAqh4KoRf1BbO-8gEvKkw3EwFF79Tcvk9qlPJ1DfsBJqHwe6QPAWkXUTeh9zR8s7Lz9atgneH5cL8DvPpZSY3SiFdgfgaZwQ7ocUgYdO8p3vDwEor8eHGcGHDY Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:31:56.497746 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f28e5935db5c4be4871d727e1958424b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f28e5935db5c4be4871d727e1958424b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f28e5935db5c4be4871d727e1958424b Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138379476 Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: ea2f8480bc7d44f6a51e4a1d875a1c7c Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeNegativeTest-1138379476-project Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.499379 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': 'cb24b55d-a68c-42ce-b470-6e1ed385c48a'} Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:31:56.500793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. Aug 04 21:31:56.502230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:31:56.505401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] Returning 404 to user: Instance cb24b55d-a68c-42ce-b470-6e1ed385c48a could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:31:56.506341 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ed548db7-6082-4fec-874a-02d0baf43b10 tempest-AttachVolumeNegativeTest-1138379476 tempest-AttachVolumeNegativeTest-1138379476-project] 10.222.0.25 "GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a" status: 404 len: 111 microversion: 2.1 time: 0.043247 Aug 04 21:31:56.507125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 445/893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:56 2022] GET /compute/v2.1/servers/cb24b55d-a68c-42ce-b470-6e1ed385c48a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:31:56.605627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7c6cdd10-ea73-48af-93a8-5bb725b9502b tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 204 len: 0 microversion: 2.1 time: 0.452622 Aug 04 21:31:56.605627 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 449/894] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:31:56 2022] DELETE /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:31:56.609406 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:56.610700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:56.617068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.617552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.617987 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.618684 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:56.619135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:56.619604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:56.946007 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:56.953713 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-78d4fada-ef4d-4906-991e-a8f122b04a2e tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1469 microversion: 2.1 time: 0.348168 Aug 04 21:31:56.954294 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 446/895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:56 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:57.485676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:57.486340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:57.493193 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:57.493666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:57.494092 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:57.494771 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:57.495214 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:57.495654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:57.632389 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:57.640123 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9d61e20a-6b09-4f0c-9494-38e6f48b7362 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.158722 Aug 04 21:31:57.641412 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 450/896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:57 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:57.979966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:57.979966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:57.982936 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:57.983679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:57.984276 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:57.985461 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:57.985604 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:57.986027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:58.257683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:58.268474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2820bfbc-9de9-4d36-9b4b-1536c95e3135 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1469 microversion: 2.1 time: 0.296496 Aug 04 21:31:58.269830 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 447/897] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:57 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:58.663614 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:58.664346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:58.667146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:58.682081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:58.683698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:58.684755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:58.696672 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:58.698924 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:58.700112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:58.771947 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-a414c328-9a6f-498e-a6b4-8b1414127ffc req-63563df1-0a12-40e8-bf09-01b00aeb0468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1850b659-92cb-469a-a250-29fc7fece53e", "name": "network-vif-deleted", "tag": "0184f180-cfcc-4202-9924-a1fba30904aa"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:31:58.785246 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a414c328-9a6f-498e-a6b4-8b1414127ffc req-63563df1-0a12-40e8-bf09-01b00aeb0468 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:58.785981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a414c328-9a6f-498e-a6b4-8b1414127ffc req-63563df1-0a12-40e8-bf09-01b00aeb0468 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:58.786564 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a414c328-9a6f-498e-a6b4-8b1414127ffc req-63563df1-0a12-40e8-bf09-01b00aeb0468 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:58.814049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-a414c328-9a6f-498e-a6b4-8b1414127ffc req-63563df1-0a12-40e8-bf09-01b00aeb0468 service nova] Creating event network-vif-deleted:0184f180-cfcc-4202-9924-a1fba30904aa for instance 1850b659-92cb-469a-a250-29fc7fece53e on hv-cinder-85220 Aug 04 21:31:58.829721 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-a414c328-9a6f-498e-a6b4-8b1414127ffc req-63563df1-0a12-40e8-bf09-01b00aeb0468 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064903 Aug 04 21:31:58.830644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 448/898] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:31:58.927553 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:58.937188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a6f32346-c540-449c-b5b4-5c7168859614 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.277921 Aug 04 21:31:58.938262 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 451/899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:58 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:59.291146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:59.292674 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:59.299114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:59.302820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:59.302820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:59.302820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:59.302820 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:59.303171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:59.310937 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:59.340309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:59.340793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:59.341219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:59.341660 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lazy-loading 'fault' on Instance uuid 1850b659-92cb-469a-a250-29fc7fece53e {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:31:59.407173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a9a76ad8914f28927418359e5a5eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5603eb09b4be40b98fe3bad6c40680b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:31:59.415685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7321de0b-caf1-4ff1-925e-608a1ae6eb41 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 200 len: 1304 microversion: 2.1 time: 0.129070 Aug 04 21:31:59.416268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 449/900] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:59 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:31:59.959964 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:31:59.960761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:31:59.967083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:59.967602 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:59.968031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:31:59.968717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:31:59.969687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:31:59.970136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:00.437715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:00.439144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] [instance: 1850b659-92cb-469a-a250-29fc7fece53e] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:00.446911 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:00.447717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:00.448310 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:00.449178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:00.449782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:00.450352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:00.465759 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] HTTP exception thrown: Instance 1850b659-92cb-469a-a250-29fc7fece53e could not be found. Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Request method failure captured: Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e HTTP/1.1 Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dq5fyZw5o_L53hRQHy92d8xKf277Dq1pFDLkC_nZwuaV4riWCr4CotaEUYHYCk2rq26WnOkdqqEoOHQUAvYsmk0Ck4q4FT7-R4-8VSGUqS7AFTyBELE_i3EzwxQX1mSHeiUT9OEda6YIvnUVdXmkHg88Hqpk59e4ThDIAgfU-MJNKs Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 5603eb09b4be40b98fe3bad6c40680b7 Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-VolumesNegativeTest-316048273 Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:32:00.467915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5603eb09b4be40b98fe3bad6c40680b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5603eb09b4be40b98fe3bad6c40680b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5603eb09b4be40b98fe3bad6c40680b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5603eb09b4be40b98fe3bad6c40680b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-VolumesNegativeTest-316048273 Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 5603eb09b4be40b98fe3bad6c40680b7 Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-VolumesNegativeTest-316048273 Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-VolumesNegativeTest-316048273-project Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: f6a9a76ad8914f28927418359e5a5eee Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-VolumesNegativeTest-316048273-project Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 1850b659-92cb-469a-a250-29fc7fece53e could not be found. Aug 04 21:32:00.469900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '1850b659-92cb-469a-a250-29fc7fece53e'} Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1850b659-92cb-469a-a250-29fc7fece53e could not be found. Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:32:00.470764 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1850b659-92cb-469a-a250-29fc7fece53e could not be found. Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1850b659-92cb-469a-a250-29fc7fece53e could not be found. Aug 04 21:32:00.471989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:00.473723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] Returning 404 to user: Instance 1850b659-92cb-469a-a250-29fc7fece53e could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:32:00.473723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7242ddc9-2d54-4881-a872-69727e48d824 tempest-VolumesNegativeTest-316048273 tempest-VolumesNegativeTest-316048273-project] 10.222.0.25 "GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e" status: 404 len: 111 microversion: 2.1 time: 0.036495 Aug 04 21:32:00.473723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 450/901] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:00 2022] GET /compute/v2.1/servers/1850b659-92cb-469a-a250-29fc7fece53e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:32:00.473940 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:00.483886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-df999f93-1915-485d-9119-1fd312736745 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.527424 Aug 04 21:32:00.485361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 452/902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:31:59 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:01.507839 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:01.512042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:01.521553 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:01.522020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:01.522654 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:01.523726 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:01.524410 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:01.525102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:01.884308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:01.895039 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4f409dad-377c-4ef3-ae0d-e188cdabfd26 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.392228 Aug 04 21:32:01.898669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 451/903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:01 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:02.916536 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:02.917134 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:02.924050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:02.924656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:02.925221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:02.926312 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:02.926875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:02.927705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:03.106076 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:03.116249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e3956d30-730c-4c47-ae75-823a3a69f1d4 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.203460 Aug 04 21:32:03.117049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 453/904] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:02 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:04.141836 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:04.142493 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:04.150325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:04.150800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:04.151470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:04.152363 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:04.156041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:04.156041 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:04.298111 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:04.307737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4fa13b00-81dd-4c23-8191-e1d40bdeaae2 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.170493 Aug 04 21:32:04.308558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 452/905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:04 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:04.971251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:04.973654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:04.988333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:04.989100 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:04.990944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:04.993113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:04.993819 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:04.994479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.066086 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c6dc1a00-b396-4faa-bf23-79c9da83139f tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.101123 Aug 04 21:32:05.069904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 454/906] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Aug 4 21:32:04 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:05.139748 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:05.140236 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:05.147459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:05.148107 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:05.148464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.149277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:05.149730 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:05.150151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.193357 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:32:05.331918 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:05.337779 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:05.341534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:05.342026 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:05.342459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.343154 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:05.343644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:05.344581 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.484483 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:05.496790 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-88c1bb0e-666d-4043-922e-6bd5ce772cc3 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.171588 Aug 04 21:32:05.497357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 455/907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:05 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:32:05.502792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-888cf924-1cf6-4c00-b080-a527c26a135d tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 204 len: 0 microversion: 2.20 time: 0.366953 Aug 04 21:32:05.503413 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 453/908] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Aug 4 21:32:05 2022] DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 21:32:05.523550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:05.524150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:05.531269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:05.532554 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:05.532986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.533667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:05.534268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:05.534843 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:05.697223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:05.706188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:05.713417 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:05.715229 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2c56bd1b-6319-4549-be18-87b13ab5233b tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.200079 Aug 04 21:32:05.719632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 456/909] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:32:05 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:32:06.526328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:06.527879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:06.541090 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:06.542630 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:06.544098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:06.545734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:06.546866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:06.548021 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:06.711264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:06.724515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1f03a1d8-a0cb-48ad-8680-584b89f27fc0 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.208413 Aug 04 21:32:06.725696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 454/910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:06 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:06.742742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:06.743571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:06.752310 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:06.752906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:06.753443 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:06.754540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:06.755058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:06.755632 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:06.961428 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:06.975557 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:06.977634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:06.978894 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-802347a9-c103-4e0d-85f4-6856050665b3 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1723 microversion: 2.20 time: 0.241597 Aug 04 21:32:06.979567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 457/911] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:32:06 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 21:32:07.749032 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:07.749651 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:07.756297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:07.756990 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:07.757856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:07.759201 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:07.760005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:07.760583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:07.888679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-d6452c93-7b9c-416c-9fea-6ab71d732278 req-80eb29ff-8079-4740-ad0b-58206fe2a3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d64b73-0f15-4da6-b57b-6348065daa31", "name": "network-vif-deleted", "tag": "64050a1a-89e0-4b5a-9256-b0383669af7d"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:32:07.889280 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-d6452c93-7b9c-416c-9fea-6ab71d732278 req-80eb29ff-8079-4740-ad0b-58206fe2a3f3 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:07.890150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-d6452c93-7b9c-416c-9fea-6ab71d732278 req-80eb29ff-8079-4740-ad0b-58206fe2a3f3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:07.898043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-d6452c93-7b9c-416c-9fea-6ab71d732278 req-80eb29ff-8079-4740-ad0b-58206fe2a3f3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:07.912407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-d6452c93-7b9c-416c-9fea-6ab71d732278 req-80eb29ff-8079-4740-ad0b-58206fe2a3f3 service nova] Creating event network-vif-deleted:64050a1a-89e0-4b5a-9256-b0383669af7d for instance 57d64b73-0f15-4da6-b57b-6348065daa31 on hv-cinder-85220 Aug 04 21:32:07.922726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-d6452c93-7b9c-416c-9fea-6ab71d732278 req-80eb29ff-8079-4740-ad0b-58206fe2a3f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047188 Aug 04 21:32:07.929760 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 458/912] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:32:08.003562 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:08.004336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:08.013609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:08.014521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:08.017433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:08.017433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:08.017433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:08.018278 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:08.116924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:08.138044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-96b8ae33-1382-444e-869d-a78022368eaa tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.393073 Aug 04 21:32:08.145095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 455/913] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:07 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:08.176128 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:08.193246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:08.199482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4087b29e666c4afaa36118e82eb169d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48234ebc0b1341719ebf2a9419cb6b54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:08.199482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f3fc48f0-84bc-4fbb-ab89-72a704a5e9aa tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 200 len: 1656 microversion: 2.20 time: 0.198647 Aug 04 21:32:08.199482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 459/914] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:32:07 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 1656 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 21:32:08.422234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-8cbeee95-b884-44c8-b39f-eaee14e440c1 req-50f97085-314e-4b86-a78c-670108f366f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "name": "network-vif-plugged", "status": "completed", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:32:08.445644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8cbeee95-b884-44c8-b39f-eaee14e440c1 req-50f97085-314e-4b86-a78c-670108f366f9 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:08.446095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8cbeee95-b884-44c8-b39f-eaee14e440c1 req-50f97085-314e-4b86-a78c-670108f366f9 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:08.446529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-8cbeee95-b884-44c8-b39f-eaee14e440c1 req-50f97085-314e-4b86-a78c-670108f366f9 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:08.468247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-8cbeee95-b884-44c8-b39f-eaee14e440c1 req-50f97085-314e-4b86-a78c-670108f366f9 service nova] Creating event network-vif-plugged:6810b4c6-6579-4d40-809f-060dd869530f for instance 0af22041-6737-4c9b-b8c2-896666da1473 on hv-cinder-85220 Aug 04 21:32:08.473439 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-8cbeee95-b884-44c8-b39f-eaee14e440c1 req-50f97085-314e-4b86-a78c-670108f366f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054968 Aug 04 21:32:08.474060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 456/915] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:32:09.167513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:09.168313 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:09.180453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:09.189276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:09.189276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:09.189276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:09.189276 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:09.190373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:09.207609 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:09.223899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:09.224590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:09.245540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:09.246142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:09.246810 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:09.247738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:09.248199 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:09.248700 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:09.279133 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] HTTP exception thrown: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Request method failure captured: Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 HTTP/1.1 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk9DSvJsQP5iMAxn11aV3P4XZG7Y-4Rz32UQF0i9_h0YkqkzQ1FYQiAX08UqOydYU8h5pvzpRbFp7UrqzhQvpTMv2yWV6R8iJ2qcapXVf6g_XRh_9eWm12Zqiisc1eM05eEdUipeT5O1Pi4iIaHc5QLRvvfAUP8bVL5zMG0q50QaSY Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:32:09.283300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 4087b29e666c4afaa36118e82eb169d3 Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:09.284846 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '57d64b73-0f15-4da6-b57b-6348065daa31'} Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:32:09.291854 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:09.294297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:09.296563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Returning 404 to user: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:32:09.296563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1f9770fa-f93f-4ebe-ae53-18d75250b21c tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 404 len: 111 microversion: 2.20 time: 0.066441 Aug 04 21:32:09.296563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 457/916] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:32:09 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:32:09.301899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-799b082f-78ab-4269-9865-148821cdff94 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '.version_select at 0x7f8e70dbaa60>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:09.406047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:09.407766 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-799b082f-78ab-4269-9865-148821cdff94 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111205064" status: 204 len: 0 microversion: 2.20 time: 0.112754 Aug 04 21:32:09.408441 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 458/917] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Aug 4 21:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111205064 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 21:32:09.413885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a22de0b3-1416-4f0b-a675-48fef0f613ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1574 microversion: 2.1 time: 0.251746 Aug 04 21:32:09.414745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 460/918] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:09 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1574 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:32:10.437107 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:10.439010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:10.448468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:10.449477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:10.450398 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:10.451511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:10.451962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:10.452653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:10.602434 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:32:10.633055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-030ccca1-20f0-4eb2-9979-d552753918c7 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1561 microversion: 2.1 time: 0.177645 Aug 04 21:32:10.633055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 459/919] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:32:10 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:32:11.782266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:11.784416 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:11.792221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:11.792740 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:11.793347 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:11.794206 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:11.795031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:11.796158 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:11.813153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] HTTP exception thrown: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Request method failure captured: Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 HTTP/1.1 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk9DSvJsQP5iMAxn11aV3P4XZG7Y-4Rz32UQF0i9_h0YkqkzQ1FYQiAX08UqOydYU8h5pvzpRbFp7UrqzhQvpTMv2yWV6R8iJ2qcapXVf6g_XRh_9eWm12Zqiisc1eM05eEdUipeT5O1Pi4iIaHc5QLRvvfAUP8bVL5zMG0q50QaSY Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:32:11.814917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 4087b29e666c4afaa36118e82eb169d3 Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.816474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '57d64b73-0f15-4da6-b57b-6348065daa31'} Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:32:11.817394 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.818984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.821011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Returning 404 to user: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:32:11.821011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4572326c-de73-4306-aa08-1611f73ba118 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 404 len: 111 microversion: 2.20 time: 0.038738 Aug 04 21:32:11.821011 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 461/920] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Aug 4 21:32:11 2022] DELETE /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:32:11.825058 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:11.825667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 57d64b73-0f15-4da6-b57b-6348065daa31] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:11.832369 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:11.832847 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:11.836035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:11.836035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:11.836035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:11.836035 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:11.849105 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] HTTP exception thrown: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Request method failure captured: Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 HTTP/1.1 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk9DSvJsQP5iMAxn11aV3P4XZG7Y-4Rz32UQF0i9_h0YkqkzQ1FYQiAX08UqOydYU8h5pvzpRbFp7UrqzhQvpTMv2yWV6R8iJ2qcapXVf6g_XRh_9eWm12Zqiisc1eM05eEdUipeT5O1Pi4iIaHc5QLRvvfAUP8bVL5zMG0q50QaSY Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:32:11.850798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 4087b29e666c4afaa36118e82eb169d3 Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.852316 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '57d64b73-0f15-4da6-b57b-6348065daa31'} Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:32:11.853096 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. Aug 04 21:32:11.854314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:11.855429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Returning 404 to user: Instance 57d64b73-0f15-4da6-b57b-6348065daa31 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:32:11.855429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c6fb5fe8-0ed7-4bb4-be12-52d0b283ed37 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31" status: 404 len: 111 microversion: 2.20 time: 0.030890 Aug 04 21:32:11.856237 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 460/921] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:32:11 2022] GET /compute/v2.1/servers/57d64b73-0f15-4da6-b57b-6348065daa31 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:32:13.322260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:13.322886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:13.341264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:13.341264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:13.341264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:13.341264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:13.341615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:13.341615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:13.356445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] HTTP exception thrown: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Request method failure captured: Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 HTTP/1.1 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Dk9DSvJsQP5iMAxn11aV3P4XZG7Y-4Rz32UQF0i9_h0YkqkzQ1FYQiAX08UqOydYU8h5pvzpRbFp7UrqzhQvpTMv2yWV6R8iJ2qcapXVf6g_XRh_9eWm12Zqiisc1eM05eEdUipeT5O1Pi4iIaHc5QLRvvfAUP8bVL5zMG0q50QaSY Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:32:13.358084 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 4087b29e666c4afaa36118e82eb169d3 Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.360255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '28509a51-71ec-4aab-a7c1-bfb56ed3a676'} Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:32:13.361111 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.362372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.364638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Returning 404 to user: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:32:13.364638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-05f20732-3c8f-48bf-9c1c-b4572af7efc1 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 404 len: 111 microversion: 2.20 time: 0.041900 Aug 04 21:32:13.364638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 462/922] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Aug 4 21:32:13 2022] DELETE /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:32:13.369181 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:32:13.369784 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] [instance: 28509a51-71ec-4aab-a7c1-bfb56ed3a676] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:32:13.377225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:13.380191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:13.380191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:13.380191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:32:13.380191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:32:13.380575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:32:13.399069 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] HTTP exception thrown: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Request method failure captured: Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 HTTP/1.1 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dk9DSvJsQP5iMAxn11aV3P4XZG7Y-4Rz32UQF0i9_h0YkqkzQ1FYQiAX08UqOydYU8h5pvzpRbFp7UrqzhQvpTMv2yWV6R8iJ2qcapXVf6g_XRh_9eWm12Zqiisc1eM05eEdUipeT5O1Pi4iIaHc5QLRvvfAUP8bVL5zMG0q50QaSY Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:32:13.400976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/48234ebc0b1341719ebf2a9419cb6b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 48234ebc0b1341719ebf2a9419cb6b54 Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1074596261 Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 4087b29e666c4afaa36118e82eb169d3 Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1074596261-project Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.402452 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '28509a51-71ec-4aab-a7c1-bfb56ed3a676'} Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:32:13.404221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. Aug 04 21:32:13.410152 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:32:13.411832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] Returning 404 to user: Instance 28509a51-71ec-4aab-a7c1-bfb56ed3a676 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:32:13.411832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6e24b018-cbeb-4224-b8f1-0ef67fdab917 tempest-AttachVolumeShelveTestJSON-1074596261 tempest-AttachVolumeShelveTestJSON-1074596261-project] 10.222.0.25 "GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676" status: 404 len: 111 microversion: 2.20 time: 0.037140 Aug 04 21:32:13.411832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 461/923] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Aug 4 21:32:13 2022] GET /compute/v2.1/servers/28509a51-71ec-4aab-a7c1-bfb56ed3a676 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 21:32:26.265501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=23 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:26.512618 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e490cfe1-9d28-4bd6-8405-760da7769975 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Action: 'create', calling method: .version_select at 0x7f8e70cdfd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1320534295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvlJU9+NRKEcd6GkBoivR8zUPrF27By3AA6AXAEPaYLMJw8wHzUc7gOyJ/9zX59nnEV9OTl4MnajOmmeXl3fbphVO7Ri+aPTgOO7iqsQPrrz7ICFmMBoyJsmQ5oM42pLg=="}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:32:26.561209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-e490cfe1-9d28-4bd6-8405-760da7769975 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:32:26.582651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-e490cfe1-9d28-4bd6-8405-760da7769975 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for user b665d491470f4a0b95c13f51e19d2046 and project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:32:26.675972 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e490cfe1-9d28-4bd6-8405-760da7769975 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.416960 Aug 04 21:32:26.682234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 463/924] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:32:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:00.881345 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-624458374", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320534295", "security_groups": [{"name": "tempest-secgroup-smoke-1205312341"}], "block_device_mapping_v2": [{"uuid": "0984b370-8efe-4400-ac30-73e904e98e09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59d113d5-0697-4e33-8c52-349214c72cf5"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:00.891003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:00.891698 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:01.016998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] validate_networks() for [('59d113d5-0697-4e33-8c52-349214c72cf5', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:33:01.519155 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:33:01.520070 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:33:01.520759 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:33:01.521343 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:33:01.521833 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:33:01.530887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:01.531393 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:01.531832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:01.532565 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:01.533020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:01.533447 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:01.553164 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:33:01.557287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for user b665d491470f4a0b95c13f51e19d2046 and project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:33:01.621374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:33:01.624176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0984b370-8efe-4400-ac30-73e904e98e09',volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:33:02.086423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-42105b2f-9097-4dc3-87ec-4349274c4abd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.210118 Aug 04 21:33:02.093593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 462/925] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:33:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:33:02.102685 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=9 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:02.104710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=4 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:02.108899 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-21f882af-34be-4af0-8828-6c882b665f41 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:02.110081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-21f882af-34be-4af0-8828-6c882b665f41 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:02.169615 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-21f882af-34be-4af0-8828-6c882b665f41 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:02.176947 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-21f882af-34be-4af0-8828-6c882b665f41 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1094 microversion: 2.1 time: 0.075523 Aug 04 21:33:02.177752 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 464/926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:02 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:03.211359 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:03.212149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:03.220787 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:03.221277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:03.221745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:03.222465 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:03.222926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:03.223391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:03.290250 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:03.297851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e222fc18-1587-4059-a573-f9180d348db9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1144 microversion: 2.1 time: 0.092516 Aug 04 21:33:03.298411 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 463/927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:03 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:04.319631 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:04.320260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:04.327788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:04.328279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:04.328710 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:04.330521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:04.330981 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:04.331935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:04.413992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:04.421568 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-89098117-0fa1-4de4-ae95-c86b99fd0ce7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1192 microversion: 2.1 time: 0.107311 Aug 04 21:33:04.422151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 465/928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:04 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:05.446667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:05.447356 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:05.453938 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:05.454418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:05.454851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:05.455568 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:05.456024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:05.457058 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:05.526168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:05.534209 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-48717191-edfc-405c-b643-9013d01c9b45 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1192 microversion: 2.1 time: 0.092548 Aug 04 21:33:05.534832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 464/929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:05 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:06.556464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:06.557344 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:06.563744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:06.564220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:06.564650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:06.565580 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:06.566650 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:06.567123 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:06.636528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:06.644364 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-925ba440-f88a-446f-ae48-66f2240450da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1192 microversion: 2.1 time: 0.091558 Aug 04 21:33:06.645023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 466/930] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:06 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:07.665894 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:07.668087 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:07.676503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:07.677066 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:07.677590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:07.678556 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:07.679074 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:07.679667 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:07.751147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:07.759364 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-62136eeb-febe-4ad5-972f-d47e441639dc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1210 microversion: 2.1 time: 0.097529 Aug 04 21:33:07.759936 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 465/931] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:07 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:08.783082 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:08.783770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:08.790831 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:08.791310 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:08.791854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:08.792645 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:08.793091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:08.793546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:08.986913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:08.998863 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-df46837f-e48f-4bba-8e55-75bc42eca74c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.219710 Aug 04 21:33:09.000998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 467/932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:08 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:09.074902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-3da80c50-242f-4ee8-986a-32b1a8cbe1b3 req-c793e28c-9db2-44ec-b9b8-610485769df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b166cb-3712-4ff3-bed4-ec30a537e1d2", "tag": "207ed98e-cfbe-491b-9fc8-1422019f3d94"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:09.097781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3da80c50-242f-4ee8-986a-32b1a8cbe1b3 req-c793e28c-9db2-44ec-b9b8-610485769df8 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:09.099351 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3da80c50-242f-4ee8-986a-32b1a8cbe1b3 req-c793e28c-9db2-44ec-b9b8-610485769df8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:09.100340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3da80c50-242f-4ee8-986a-32b1a8cbe1b3 req-c793e28c-9db2-44ec-b9b8-610485769df8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:09.123436 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-3da80c50-242f-4ee8-986a-32b1a8cbe1b3 req-c793e28c-9db2-44ec-b9b8-610485769df8 service nova] Creating event network-changed:207ed98e-cfbe-491b-9fc8-1422019f3d94 for instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 on hv-cinder-85220 Aug 04 21:33:09.131518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-3da80c50-242f-4ee8-986a-32b1a8cbe1b3 req-c793e28c-9db2-44ec-b9b8-610485769df8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063564 Aug 04 21:33:09.133191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 466/933] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:10.025923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:10.026540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:10.033074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:10.033488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:10.033916 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:10.034599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:10.035043 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:10.035683 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:10.171246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:10.179545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-31de293a-6fca-4893-954d-76df794e2236 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.157422 Aug 04 21:33:10.180116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 468/934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:10 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:11.204301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:11.205401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:11.213801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:11.214430 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:11.214965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:11.215843 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:11.216394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:11.216939 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:11.432511 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:11.441423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4887c9d2-3cb1-4087-a041-2728ee308a27 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.243472 Aug 04 21:33:11.442150 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 467/935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:11 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:12.464746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:12.465347 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:12.472825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:12.474434 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:12.474642 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:12.475220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:12.475720 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:12.476258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:12.644112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:12.653826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c0014aa6-31a3-441c-8c73-f17e3bb8a49a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.192743 Aug 04 21:33:12.654514 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 469/936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:12 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:13.671427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:13.672800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:13.678541 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:13.679204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:13.685976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:13.690508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:13.690508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:13.690508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:13.690508 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:13.691176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:13.873878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:13.885415 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-741f6b29-6714-4f79-b5ca-a322610b3f42 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.214880 Aug 04 21:33:13.900200 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 468/937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:13 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:14.910405 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:14.911429 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:14.916129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:14.920745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:14.921283 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:14.921789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:14.922436 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:14.922884 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:14.923299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:15.106458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:15.115362 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-36639dd5-8611-4068-901e-3435f54eb689 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.208950 Aug 04 21:33:15.116215 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 470/938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:14 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:16.152295 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:16.153102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:16.161334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:16.161857 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:16.162288 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:16.162988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:16.163478 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:16.163900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:16.311699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:16.322691 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9160cf5b-0b54-48fa-9379-0d01a31005b8 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.174355 Aug 04 21:33:16.323281 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 469/939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:16 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:17.349792 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:17.350317 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:17.360895 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:17.361449 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:17.361917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:17.363138 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:17.363633 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:17.364049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:17.717869 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:17.726654 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e39f7a76-0781-41a4-9928-1b85abd01c6b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.385169 Aug 04 21:33:17.727657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 471/940] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:17 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:18.753046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:18.763219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:18.763219 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:18.763677 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:18.764078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:18.764805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:18.765250 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:18.765695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:18.949838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:18.972593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f0c5e2d6-e654-44e4-8143-b3d4a76544f6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.222950 Aug 04 21:33:18.974020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 470/941] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:18 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:20.010415 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:20.011010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:20.017915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:20.019120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:20.019679 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:20.020504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:20.020926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:20.021397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:20.194169 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:20.231796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-70828abd-69a1-49a6-b84f-c092779034fc tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.224945 Aug 04 21:33:20.232751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 472/942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:20 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:21.255569 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:21.256693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:21.267842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:21.269344 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:21.269954 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:21.273172 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:21.273172 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:21.273172 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:21.471274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:21.490385 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-9b6ad63a-0f0e-4e65-8d00-9d760d6e7dbd tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.239570 Aug 04 21:33:21.490973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 471/943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:21 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:22.522322 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:22.523719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:22.535799 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-a4748d8e-98df-4b9d-b782-044b44d825e5 req-f3f1f306-92af-49e2-b373-5d53ea0278cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b166cb-3712-4ff3-bed4-ec30a537e1d2", "name": "network-vif-plugged", "status": "completed", "tag": "207ed98e-cfbe-491b-9fc8-1422019f3d94"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:22.537992 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:22.538886 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:22.539746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:22.541385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:22.542359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:22.543528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:22.551227 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a4748d8e-98df-4b9d-b782-044b44d825e5 req-f3f1f306-92af-49e2-b373-5d53ea0278cd service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:22.551740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a4748d8e-98df-4b9d-b782-044b44d825e5 req-f3f1f306-92af-49e2-b373-5d53ea0278cd service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:22.552173 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-a4748d8e-98df-4b9d-b782-044b44d825e5 req-f3f1f306-92af-49e2-b373-5d53ea0278cd service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:22.564972 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-a4748d8e-98df-4b9d-b782-044b44d825e5 req-f3f1f306-92af-49e2-b373-5d53ea0278cd service nova] Creating event network-vif-plugged:207ed98e-cfbe-491b-9fc8-1422019f3d94 for instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 on hv-cinder-85220 Aug 04 21:33:22.572899 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-a4748d8e-98df-4b9d-b782-044b44d825e5 req-f3f1f306-92af-49e2-b373-5d53ea0278cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041149 Aug 04 21:33:22.578288 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 472/944] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:33:22.812788 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:22.822875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ef744577-fefa-4f84-9620-3eaa2cb74774 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.308374 Aug 04 21:33:22.823484 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 473/945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:22 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:23.844576 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:23.845437 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:23.853692 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:23.854449 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:23.855093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:23.856020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:23.856662 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:23.857293 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:24.041733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:24.050548 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a837904d-dc5a-4da8-8dc8-336c13369254 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1266 microversion: 2.1 time: 0.210152 Aug 04 21:33:24.052175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 473/946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:23 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:25.078041 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:25.078711 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:25.085913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:25.086402 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:25.086831 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:25.087555 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:25.088008 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:25.088433 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:25.245718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:25.254372 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2b499d3b-a8e3-4b7d-af9a-aa20ee89fb5b tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1452 microversion: 2.1 time: 0.180210 Aug 04 21:33:25.255015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 474/947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:25 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:25.275503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:25.276098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:25.282734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:25.285933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:25.285933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:25.285933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:25.285933 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:25.286514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:25.433647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:25.441969 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ab4ac0a2-2634-4e9d-8bac-7494d8f6b45f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1452 microversion: 2.1 time: 0.171085 Aug 04 21:33:25.443146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 474/948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:25 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:28.117068 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-7c69ad88-2e4f-4a4f-b8a9-46a26393fc23 req-caf47c9c-8360-476b-b00c-279efe75315b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b166cb-3712-4ff3-bed4-ec30a537e1d2", "tag": "207ed98e-cfbe-491b-9fc8-1422019f3d94"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:28.128286 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7c69ad88-2e4f-4a4f-b8a9-46a26393fc23 req-caf47c9c-8360-476b-b00c-279efe75315b service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:28.128498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7c69ad88-2e4f-4a4f-b8a9-46a26393fc23 req-caf47c9c-8360-476b-b00c-279efe75315b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:28.132126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-7c69ad88-2e4f-4a4f-b8a9-46a26393fc23 req-caf47c9c-8360-476b-b00c-279efe75315b service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:28.141015 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-7c69ad88-2e4f-4a4f-b8a9-46a26393fc23 req-caf47c9c-8360-476b-b00c-279efe75315b service nova] Creating event network-changed:207ed98e-cfbe-491b-9fc8-1422019f3d94 for instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 on hv-cinder-85220 Aug 04 21:33:28.147087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-7c69ad88-2e4f-4a4f-b8a9-46a26393fc23 req-caf47c9c-8360-476b-b00c-279efe75315b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033983 Aug 04 21:33:28.147748 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 475/949] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:33:34.771856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:34.773110 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:34.776714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:34.782910 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-9b1df94f-60a2-4883-b686-c594927bfc87 req-e369a04d-a648-40f7-b079-e1026b0b22b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:34.791368 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:34.791915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:34.792818 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:34.794757 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:34.796532 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:34.798413 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:34.799645 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:34.804503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=67 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:34.815754 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-9b1df94f-60a2-4883-b686-c594927bfc87 req-e369a04d-a648-40f7-b079-e1026b0b22b1 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:34.816418 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-9b1df94f-60a2-4883-b686-c594927bfc87 req-e369a04d-a648-40f7-b079-e1026b0b22b1 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:34.816922 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-9b1df94f-60a2-4883-b686-c594927bfc87 req-e369a04d-a648-40f7-b079-e1026b0b22b1 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:34.820132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=63 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:34.831233 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-9b1df94f-60a2-4883-b686-c594927bfc87 req-e369a04d-a648-40f7-b079-e1026b0b22b1 service nova] Creating event network-changed:6810b4c6-6579-4d40-809f-060dd869530f for instance 0af22041-6737-4c9b-b8c2-896666da1473 on hv-cinder-85220 Aug 04 21:33:34.845271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-9b1df94f-60a2-4883-b686-c594927bfc87 req-e369a04d-a648-40f7-b079-e1026b0b22b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067528 Aug 04 21:33:34.847768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 476/950] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:34.872535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:33:35.301966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b8830a0a-06ae-4220-9939-e1c05ef06e58 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 204 len: 0 microversion: 2.1 time: 0.536528 Aug 04 21:33:35.302725 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 475/951] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:33:34 2022] DELETE /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:33:35.312998 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:35.313706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:35.322003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:35.322796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:35.322931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:35.323640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:35.324127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:35.324517 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:35.504951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:35.513019 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-1a82f258-ef4c-45d7-9fc8-34b50ea001ac tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.205065 Aug 04 21:33:35.513595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 477/952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:35 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:36.536671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:36.538240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:36.552681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:36.552681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:36.552681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:36.552681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:36.553101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:36.553101 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:36.719866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:36.729365 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2a345e63-4aae-423a-b8a2-8c48b6452722 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.198459 Aug 04 21:33:36.729980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 476/953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:36 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:38.008914 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:38.009611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:38.016247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:38.017085 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:38.017700 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:38.019038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:38.021335 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:38.021808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:38.252837 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:38.261613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2b1d53b5-489a-462e-b862-963dbb87d127 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1567 microversion: 2.1 time: 0.513476 Aug 04 21:33:38.262314 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 478/954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:37 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:39.047516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-190527502", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "networks": [{"uuid": "b2c4b344-d035-4c29-8358-4f084976afa9"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:39.103393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-eb3f548a-6312-4c11-8c7c-bbbe6250643c req-a8ba7bff-192e-4ed9-a15e-99748adb9588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af22041-6737-4c9b-b8c2-896666da1473", "name": "network-vif-deleted", "tag": "6810b4c6-6579-4d40-809f-060dd869530f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:39.109991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] validate_networks() for [('b2c4b344-d035-4c29-8358-4f084976afa9', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:33:39.117336 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-eb3f548a-6312-4c11-8c7c-bbbe6250643c req-a8ba7bff-192e-4ed9-a15e-99748adb9588 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:39.118102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-eb3f548a-6312-4c11-8c7c-bbbe6250643c req-a8ba7bff-192e-4ed9-a15e-99748adb9588 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:39.118546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-eb3f548a-6312-4c11-8c7c-bbbe6250643c req-a8ba7bff-192e-4ed9-a15e-99748adb9588 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:39.130770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-eb3f548a-6312-4c11-8c7c-bbbe6250643c req-a8ba7bff-192e-4ed9-a15e-99748adb9588 service nova] Creating event network-vif-deleted:6810b4c6-6579-4d40-809f-060dd869530f for instance 0af22041-6737-4c9b-b8c2-896666da1473 on hv-cinder-85220 Aug 04 21:33:39.135833 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-eb3f548a-6312-4c11-8c7c-bbbe6250643c req-a8ba7bff-192e-4ed9-a15e-99748adb9588 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040295 Aug 04 21:33:39.136612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 479/955] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:33:39.286460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:39.287670 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:39.294422 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:39.294917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:39.295384 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:39.296411 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:39.297188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:39.297430 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:39.399829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:39.399829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-11fe7161-4976-4c20-afa6-f38de3ec4c48 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1218 microversion: 2.1 time: 0.114155 Aug 04 21:33:39.399829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 480/956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:39 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:39.575128 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:33:39.575583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:33:39.576048 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:33:39.576515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:33:39.576921 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:33:39.585991 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:39.586462 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:39.586889 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:39.587638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:39.588110 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:39.588530 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:39.605799 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Getting quotas for project 76ca8c859a9c4762afbcf40fb071c188. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:33:39.609968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Getting quotas for user d1946505fcad422ba5416834ad66050d and project 76ca8c859a9c4762afbcf40fb071c188. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:33:39.628681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:33:39.628842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:33:39.742279 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-01176e61-6768-46f9-9fa7-0229a0af87ca tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698472 Aug 04 21:33:39.742844 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 477/957] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:33:39.753749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0c57b4f1-1349-4e38-8d21-06a5a5a32cba tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:39.754678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0c57b4f1-1349-4e38-8d21-06a5a5a32cba tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:39.811467 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0c57b4f1-1349-4e38-8d21-06a5a5a32cba tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:39.821593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0c57b4f1-1349-4e38-8d21-06a5a5a32cba tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1218 microversion: 2.1 time: 0.068432 Aug 04 21:33:39.821593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 481/958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:39 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:40.423233 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:40.424454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:40.435957 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:40.437198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:40.438230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:40.438826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:40.439652 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:40.440176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:40.488176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:40.488833 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:40.495349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:40.495349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lazy-loading 'fault' on Instance uuid 0af22041-6737-4c9b-b8c2-896666da1473 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:33:40.547204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f480dbdc7237420680584ce4866b36e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b4cfcf22614a95ad77db93922449cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:40.552930 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f13d4437-2788-4542-b015-6250b2e6dc0a tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 200 len: 1223 microversion: 2.1 time: 0.135542 Aug 04 21:33:40.553829 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 478/959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:40 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:40.841467 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-06349e70-6da1-4556-883d-17554cf11d09 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:40.842077 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-06349e70-6da1-4556-883d-17554cf11d09 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:40.924320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-06349e70-6da1-4556-883d-17554cf11d09 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:40.942640 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-06349e70-6da1-4556-883d-17554cf11d09 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1218 microversion: 2.1 time: 0.104444 Aug 04 21:33:40.943983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 482/960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:40 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:41.578001 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:41.578623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] [instance: 0af22041-6737-4c9b-b8c2-896666da1473] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:41.587162 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:41.587699 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:41.588174 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:41.588885 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:41.589339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:41.589765 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:41.603922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] HTTP exception thrown: Instance 0af22041-6737-4c9b-b8c2-896666da1473 could not be found. Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Request method failure captured: Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 HTTP/1.1 Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Dn8BpmTGooUynnGvQ0zBVoXRZRgJgDICHhax_bWySUH0QFIFH6sbfFp0vX_KG6WQAFck2Brr1KIr455PsBsB-MiOadHNocZjXG2vN5SWW5zhCGapBwak1wrzMPEDIcs8cMCgPf1G1vi9SNKhUCDCDD5afq-MA6hZ5PhjMaK3teFc3g Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: f1b4cfcf22614a95ad77db93922449cd Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-TestShelveInstance-1219347992 Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:33:41.605577 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1b4cfcf22614a95ad77db93922449cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1b4cfcf22614a95ad77db93922449cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1b4cfcf22614a95ad77db93922449cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1b4cfcf22614a95ad77db93922449cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-TestShelveInstance-1219347992 Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: f1b4cfcf22614a95ad77db93922449cd Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-TestShelveInstance-1219347992 Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-TestShelveInstance-1219347992-project Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: f480dbdc7237420680584ce4866b36e9 Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-TestShelveInstance-1219347992-project Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 0af22041-6737-4c9b-b8c2-896666da1473 could not be found. Aug 04 21:33:41.607274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '0af22041-6737-4c9b-b8c2-896666da1473'} Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af22041-6737-4c9b-b8c2-896666da1473 could not be found. Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:33:41.608271 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af22041-6737-4c9b-b8c2-896666da1473 could not be found. Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af22041-6737-4c9b-b8c2-896666da1473 could not be found. Aug 04 21:33:41.609804 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:33:41.611255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Returning 404 to user: Instance 0af22041-6737-4c9b-b8c2-896666da1473 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:33:41.611255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-257baf58-0d9a-4396-9443-3c68337bf4c9 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473" status: 404 len: 111 microversion: 2.1 time: 0.032977 Aug 04 21:33:41.611255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 479/961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:41 2022] GET /compute/v2.1/servers/0af22041-6737-4c9b-b8c2-896666da1473 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:33:41.947268 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0de62eae-9d5e-4a2e-a3c3-08dc220a5350 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] Calling method '.version_select at 0x7f8e70c70a60>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:41.974646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:41.975199 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:41.984213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:41.984213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:41.984213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:41.984213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:41.984660 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:41.984793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:42.049130 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:42.056858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-42e3e3e9-a0e0-49cf-8eaa-93fc98278ab6 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1270 microversion: 2.1 time: 0.086706 Aug 04 21:33:42.057419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 480/962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:41 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:42.078950 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0de62eae-9d5e-4a2e-a3c3-08dc220a5350 tempest-TestShelveInstance-1219347992 tempest-TestShelveInstance-1219347992-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-951782273" status: 202 len: 0 microversion: 2.1 time: 0.137213 Aug 04 21:33:42.079608 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 483/963] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Aug 4 21:33:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-951782273 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:33:43.078402 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:43.079337 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:43.087605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:43.088086 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:43.088683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:43.089382 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:43.089830 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:43.090254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:43.165795 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:43.174211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2d71dbcc-2912-4f35-94ba-8b45b2d6e41c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1276 microversion: 2.1 time: 0.100554 Aug 04 21:33:43.175988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 481/964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:43 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:43.276300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:33:43.280300 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:33:44.197856 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:44.198726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:44.205636 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:44.206380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:44.207763 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:44.208625 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:44.209582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:44.209674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:44.867746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:44.876247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9346cde5-5b0b-48ba-af73-40c4624c0ab0 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.682907 Aug 04 21:33:44.876741 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 484/965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:44 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:45.898374 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:45.898984 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:45.906099 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:45.906612 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:45.907046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:45.907866 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:45.908319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:45.908743 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:46.051986 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:46.060283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4c744100-2711-495a-beb7-551b38661300 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.166010 Aug 04 21:33:46.061080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 482/966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:45 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:46.885205 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-5803f6d7-00d8-4821-abc8-eac169e060c6 req-ce9c6567-a7a4-4321-bc23-bf19746a34a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4399d671-842e-43fa-b7ac-6523488f6031", "tag": "6d659016-703d-4823-bf45-d95574693722"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:46.908965 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-5803f6d7-00d8-4821-abc8-eac169e060c6 req-ce9c6567-a7a4-4321-bc23-bf19746a34a8 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:46.908965 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-5803f6d7-00d8-4821-abc8-eac169e060c6 req-ce9c6567-a7a4-4321-bc23-bf19746a34a8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:46.909419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-5803f6d7-00d8-4821-abc8-eac169e060c6 req-ce9c6567-a7a4-4321-bc23-bf19746a34a8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:46.923746 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-5803f6d7-00d8-4821-abc8-eac169e060c6 req-ce9c6567-a7a4-4321-bc23-bf19746a34a8 service nova] Creating event network-changed:6d659016-703d-4823-bf45-d95574693722 for instance 4399d671-842e-43fa-b7ac-6523488f6031 on hv-cinder-85220 Aug 04 21:33:46.931718 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-5803f6d7-00d8-4821-abc8-eac169e060c6 req-ce9c6567-a7a4-4321-bc23-bf19746a34a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049924 Aug 04 21:33:46.933386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 485/967] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:47.083342 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:47.084029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:47.097864 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:47.098422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:47.099989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:47.100941 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:47.102614 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:47.103123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:47.386094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:47.394624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a8eda7b4-d706-4470-a020-3c562957a1da tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.315178 Aug 04 21:33:47.395040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 483/968] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:47 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:33:48.416600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:48.417299 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:48.423678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:48.424464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:48.425190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:48.426244 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:48.426814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:48.427384 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:48.829237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:48.839563 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-75ea6d3e-46da-4200-8c8d-387f0c42c3f4 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.427438 Aug 04 21:33:48.840381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 486/969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:48 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:49.862471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:49.864100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:49.870225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:49.871171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:49.873762 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:49.874464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:49.875112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:49.876146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:49.876965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:49.877721 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:50.041827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:50.054928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-88b316e7-f8d6-41a5-ab4d-2350dc50fc0f tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.196597 Aug 04 21:33:50.061394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 484/970] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:49 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:51.077791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:51.078327 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:51.081050 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=4 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:51.086392 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:51.086854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:51.087284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:51.088018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:51.088488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:51.088907 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:51.341387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:51.350977 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6c6c63a7-d807-4a2d-855a-7857bc72a645 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.277078 Aug 04 21:33:51.352377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 487/971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:51 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:51.934314 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-2bbea0e2-b782-4c9c-93e0-ae2796fd4fbb req-5d7b7fea-d0ca-47a9-885d-9d6ddfc206c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4399d671-842e-43fa-b7ac-6523488f6031", "name": "network-vif-plugged", "status": "completed", "tag": "6d659016-703d-4823-bf45-d95574693722"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:33:51.944313 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-2bbea0e2-b782-4c9c-93e0-ae2796fd4fbb req-5d7b7fea-d0ca-47a9-885d-9d6ddfc206c3 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:51.944782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-2bbea0e2-b782-4c9c-93e0-ae2796fd4fbb req-5d7b7fea-d0ca-47a9-885d-9d6ddfc206c3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:51.945204 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-2bbea0e2-b782-4c9c-93e0-ae2796fd4fbb req-5d7b7fea-d0ca-47a9-885d-9d6ddfc206c3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:51.958486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-2bbea0e2-b782-4c9c-93e0-ae2796fd4fbb req-5d7b7fea-d0ca-47a9-885d-9d6ddfc206c3 service nova] Creating event network-vif-plugged:6d659016-703d-4823-bf45-d95574693722 for instance 4399d671-842e-43fa-b7ac-6523488f6031 on hv-cinder-85220 Aug 04 21:33:51.963589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-2bbea0e2-b782-4c9c-93e0-ae2796fd4fbb req-5d7b7fea-d0ca-47a9-885d-9d6ddfc206c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Aug 04 21:33:51.964177 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 485/972] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:33:52.375589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:52.376331 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:52.383793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:52.384358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:52.384789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:52.385473 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:52.385953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:52.386386 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:52.546598 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:52.554762 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-57b869b5-a336-450b-8608-f7e4e323afc7 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.183071 Aug 04 21:33:52.555492 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 488/973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:52 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:53.576805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:53.577503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:53.584326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:53.591241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:53.591241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:53.591241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:53.591241 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:53.591690 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:53.736131 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:53.744581 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6f70128f-02b3-434c-84a5-e03f29663e07 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1318 microversion: 2.1 time: 0.172799 Aug 04 21:33:53.745155 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 486/974] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:53 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:33:54.765498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:33:54.769421 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:33:54.773482 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:54.774315 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:54.774967 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:54.775946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:33:54.776653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:33:54.777346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:33:54.989255 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:33:54.996777 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c19d27c6-11d2-4969-b9cd-0983d8567a49 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1506 microversion: 2.1 time: 0.235394 Aug 04 21:33:54.997525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 489/975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:33:54 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:11.863330 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95daebf6-00df-49c8-be52-ed84d0ebfa73", "device": "/dev/sdb"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:11.866646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:11.869268 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:11.869934 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:11.874800 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:11.875433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:11.877297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:11.877297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:11.877297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:11.877601 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:12.613801 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e4c33b6f-1f64-49af-a151-707cf2852084 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "POST /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754107 Aug 04 21:34:12.614728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 487/976] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:34:11 2022] POST /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:18.570661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b05cd8be-faf0-4390-8b78-58c30a92441c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Action: 'create', calling method: .version_select at 0x7f8e70c7f430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-112280599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAh5tADg+1eDXw/4/PjZUeQEpPCm5DjTS3oRK7b2+lldWENFAe9PWsdRkMGrBG/xsYwuN+CkRnbpI2HCpWlmvBaynRKXBRNxJdZlu0hkdpczslo22V3AnlLB0KQn1BXvg=="}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:18.576458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:18.577172 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=53 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:18.588180 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-b05cd8be-faf0-4390-8b78-58c30a92441c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Getting quotas for project a7664cec57944fccbca1522095567ab8. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:34:18.591887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.quota [None req-b05cd8be-faf0-4390-8b78-58c30a92441c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Getting quotas for user 2fc55eab88954503807d531cadd08543 and project a7664cec57944fccbca1522095567ab8. Resources: {'key_pairs'} {{(pid=118549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:34:18.689042 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b05cd8be-faf0-4390-8b78-58c30a92441c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.122100 Aug 04 21:34:18.689638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 490/977] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Aug 4 21:34:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:34:18.797371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1111706349", "imageRef": "7aed4088-b55e-41f0-912a-b9803a412ba6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-112280599", "networks": [{"uuid": "4d4b79cb-87a1-4b18-87b0-6dc27d7a239b"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:18.852849 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] validate_networks() for [('4d4b79cb-87a1-4b18-87b0-6dc27d7a239b', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:34:19.238770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:34:19.239188 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:34:19.239683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:34:19.240117 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:34:19.240520 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:34:19.250140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:19.250612 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:19.251042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:19.251812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:19.252297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:19.252713 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:19.270757 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Getting quotas for project a7664cec57944fccbca1522095567ab8. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:34:19.275115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Getting quotas for user 2fc55eab88954503807d531cadd08543 and project a7664cec57944fccbca1522095567ab8. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:34:19.287004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:34:19.289306 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aed4088-b55e-41f0-912a-b9803a412ba6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:34:19.461951 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-865b9d73-b22c-4c2c-ac29-bc7e6e16cfe8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669132 Aug 04 21:34:19.462611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 488/978] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:34:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:34:19.474623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2a699ae2-dde3-4dad-9d93-f5fa4572c3a5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:19.475234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2a699ae2-dde3-4dad-9d93-f5fa4572c3a5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:19.536040 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2a699ae2-dde3-4dad-9d93-f5fa4572c3a5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:19.543980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2a699ae2-dde3-4dad-9d93-f5fa4572c3a5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1258 microversion: 2.1 time: 0.073790 Aug 04 21:34:19.544618 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 491/979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:19 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:20.565093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e5268430-5076-4d8d-aedb-e84b23117682 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:20.565729 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e5268430-5076-4d8d-aedb-e84b23117682 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:20.621407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-e5268430-5076-4d8d-aedb-e84b23117682 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:20.629964 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e5268430-5076-4d8d-aedb-e84b23117682 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1258 microversion: 2.1 time: 0.069181 Aug 04 21:34:20.630535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 489/980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:20 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:34:21.650917 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:21.651648 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:21.658753 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:21.659236 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:21.659704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:21.660397 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:21.660845 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:21.661292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:21.722437 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:21.729768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c2ec3a6c-0f11-4838-8bef-9abc7524b8ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1254 microversion: 2.1 time: 0.082695 Aug 04 21:34:21.730311 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 492/981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:21 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1254 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:22.750905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:22.751555 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:22.759078 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:22.759593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:22.760032 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:22.760717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:22.761168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:22.761590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:22.821006 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:22.828611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c3d58886-7714-476d-b579-6e430e9be180 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1254 microversion: 2.1 time: 0.081537 Aug 04 21:34:22.829171 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 490/982] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:22 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:23.852476 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:23.853541 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:23.860959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:23.861545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:23.862060 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:23.862817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:23.863605 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:23.864104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:23.962856 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:23.970387 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-53d1d2d0-ddfc-4772-abd0-d4ca00470ebf tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1254 microversion: 2.1 time: 0.122192 Aug 04 21:34:23.970961 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 493/983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:23 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1254 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:24.990965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:24.992325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:24.999217 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:24.999739 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:25.008289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:25.009045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:25.009518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:25.009966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:25.081901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:25.089252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c3ad9ddc-4e63-4b5c-938f-61a77708a63c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1316 microversion: 2.1 time: 0.102507 Aug 04 21:34:25.089973 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 491/984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:24 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:26.110803 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:26.112230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:26.121373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:26.121853 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:26.122279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:26.122970 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:26.123446 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:26.123864 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:26.280194 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:26.288464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8cb2a433-6b85-422a-a8a9-54197f4eaffe tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.182203 Aug 04 21:34:26.289023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 494/985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:26 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:27.308955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:27.309529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:27.316051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:27.316520 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:27.317067 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:27.317930 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:27.318417 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:27.318843 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:27.457323 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:27.465112 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3eae075a-f3b8-464f-a0f2-8934804058ce tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.159801 Aug 04 21:34:27.465605 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 492/986] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:27 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:28.486072 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:28.486689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:28.493637 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:28.494116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:28.494551 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:28.495239 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:28.495722 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:28.496146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:28.633051 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:28.640594 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b42f5620-40b6-42e2-808c-84075c5291dd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.158410 Aug 04 21:34:28.641155 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 495/987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:28 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:29.662225 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:29.662832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:29.665468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:29.670754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:29.671485 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:29.672113 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:29.672997 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:29.673771 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:29.674524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:29.836274 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:29.845207 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-250095d7-42f2-4ddd-b640-5f335d850b89 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.187668 Aug 04 21:34:29.846001 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 493/988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:29 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:30.868524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:30.869153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:30.871454 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=6 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:30.876210 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:30.876682 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:30.877113 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:30.877796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:30.878243 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:30.878659 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:31.013083 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:31.021595 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-93f9e2b3-fd4f-45cb-93d4-fd6c693416f2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.157291 Aug 04 21:34:31.023158 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 496/989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:30 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:32.046278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:32.047034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:32.049044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=8 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:32.055486 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:32.056055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:32.056498 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:32.057203 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:32.057657 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:32.058157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:32.199213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:32.206603 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b73b52ad-453e-415f-b96b-4cc37e03c5a1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.165690 Aug 04 21:34:32.207170 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 494/990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:32 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:33.235883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:33.235883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:33.239302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:33.239819 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:33.240250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:33.241091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:33.241699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:33.242116 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:33.375576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:33.384427 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cede63c0-98f6-450b-96cb-b876cc1f36a3 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.160304 Aug 04 21:34:33.384980 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 497/991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:33 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:34:34.406693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:34.407348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:34.414625 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:34.417887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:34.417887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:34.417887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:34.417887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:34.418308 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:34.566149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:34.574272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f3310177-0499-4384-894a-9db658ef3d9d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.171921 Aug 04 21:34:34.575183 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 495/992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:34 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:34.872504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-6617b46b-cd0c-4bf7-9375-b7538dc40fd4 req-b58c1044-7fc6-45eb-afc8-64f3dd61c82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:34.883776 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-6617b46b-cd0c-4bf7-9375-b7538dc40fd4 req-b58c1044-7fc6-45eb-afc8-64f3dd61c82d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:34.884247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-6617b46b-cd0c-4bf7-9375-b7538dc40fd4 req-b58c1044-7fc6-45eb-afc8-64f3dd61c82d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:34.884665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-6617b46b-cd0c-4bf7-9375-b7538dc40fd4 req-b58c1044-7fc6-45eb-afc8-64f3dd61c82d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:34.898690 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-6617b46b-cd0c-4bf7-9375-b7538dc40fd4 req-b58c1044-7fc6-45eb-afc8-64f3dd61c82d service nova] Creating event network-changed:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:34:34.904039 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-6617b46b-cd0c-4bf7-9375-b7538dc40fd4 req-b58c1044-7fc6-45eb-afc8-64f3dd61c82d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036893 Aug 04 21:34:34.909734 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 498/993] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:34:35.595397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:35.596164 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:35.603527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:35.604005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:35.604429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:35.605307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:35.605751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:35.606228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:35.738970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:35.747092 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-37ade01a-0930-49a3-bdb2-c531072668b7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.155765 Aug 04 21:34:35.747693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 496/994] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:35 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:36.767983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:36.768672 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:36.777513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:36.778028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:36.778451 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:36.779132 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:36.779714 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:36.780130 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:36.914086 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:36.921755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-05764384-0a4f-4a53-912e-e81e1f65de4e tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.158026 Aug 04 21:34:36.922311 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 499/995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:36 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:37.400908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:37.401450 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:37.407848 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:37.408319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:37.408750 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:37.409429 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:37.409874 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:37.410290 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:37.492628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lazy-loading 'services' on Instance uuid 4399d671-842e-43fa-b7ac-6523488f6031 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:34:37.722068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6f7e97b9-b09c-4b10-8887-1fe430b85747 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031/os-volume_attachments/95daebf6-00df-49c8-be52-ed84d0ebfa73" status: 202 len: 0 microversion: 2.1 time: 0.324900 Aug 04 21:34:37.722781 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 497/996] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:34:37 2022] DELETE /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031/os-volume_attachments/95daebf6-00df-49c8-be52-ed84d0ebfa73 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:34:37.943346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:37.943945 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:37.950745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:37.959269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:37.959269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:37.959269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:37.959269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:37.959758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:38.097359 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:38.105501 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ec890699-7c2f-488b-9b6c-b2c70d7c1d98 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.166170 Aug 04 21:34:38.106077 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 500/997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:37 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:38.846467 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:38.847037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:38.853413 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:38.853894 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:38.854332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:38.855027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:38.855521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:38.855949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:38.884000 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:34:39.126529 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:39.127088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:39.133868 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:39.134355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:39.134795 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:39.135534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:39.135986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:39.136409 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:39.207778 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fba9bad2-a31d-4873-abf9-f45ad4c49ef5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 204 len: 0 microversion: 2.1 time: 0.365790 Aug 04 21:34:39.208492 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 498/998] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:34:38 2022] DELETE /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:34:39.217111 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:39.219077 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:39.224049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:39.224537 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:39.225034 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:39.226255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:39.226832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:39.227260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:39.270413 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:39.279040 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-21c12929-9205-491d-ac0e-8137ef33fb54 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.156661 Aug 04 21:34:39.279657 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 501/999] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:39 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:34:39.377442 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:39.384897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f4f0beb2-b238-4bd0-9c62-584aaa605699 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1512 microversion: 2.1 time: 0.171890 Aug 04 21:34:39.392247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 499/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:39 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:34:40.134242 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-c5ecdf18-4c4d-4724-a97c-74eb658d9b16 req-761ef2b6-f478-463b-97f6-62e72aaf8f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "name": "network-vif-plugged", "status": "completed", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:40.144201 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-c5ecdf18-4c4d-4724-a97c-74eb658d9b16 req-761ef2b6-f478-463b-97f6-62e72aaf8f57 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:40.144585 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-c5ecdf18-4c4d-4724-a97c-74eb658d9b16 req-761ef2b6-f478-463b-97f6-62e72aaf8f57 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:40.145013 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-c5ecdf18-4c4d-4724-a97c-74eb658d9b16 req-761ef2b6-f478-463b-97f6-62e72aaf8f57 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:40.156944 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-c5ecdf18-4c4d-4724-a97c-74eb658d9b16 req-761ef2b6-f478-463b-97f6-62e72aaf8f57 service nova] Creating event network-vif-plugged:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:34:40.162537 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-c5ecdf18-4c4d-4724-a97c-74eb658d9b16 req-761ef2b6-f478-463b-97f6-62e72aaf8f57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034734 Aug 04 21:34:40.166403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 502/1001] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:40.302968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:40.303772 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:40.313824 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:40.314520 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:40.315255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:40.316285 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:40.316882 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:40.317470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:40.406626 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:40.407329 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:40.413759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:40.414232 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:40.414663 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:40.415367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:40.415842 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:40.416258 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:40.465147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:40.473835 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0452ec2c-be0e-4bc8-932c-1445aad23681 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.176256 Aug 04 21:34:40.474583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 500/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:40 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:40.564824 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:40.574175 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ccd1f589-5243-4db5-870b-fed2874a1801 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1512 microversion: 2.1 time: 0.171675 Aug 04 21:34:40.577225 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 503/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:40 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:34:41.502326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:41.502914 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:41.509946 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:41.510422 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:41.511686 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:41.512542 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:41.513211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:41.513636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:41.527037 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-080be791-c9a2-4587-94b6-692147c6862f req-97160301-f4eb-4292-b875-dd7c60e2518e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4399d671-842e-43fa-b7ac-6523488f6031", "name": "network-vif-deleted", "tag": "6d659016-703d-4823-bf45-d95574693722"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:41.536887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:41.537968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-080be791-c9a2-4587-94b6-692147c6862f req-97160301-f4eb-4292-b875-dd7c60e2518e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:41.538452 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-080be791-c9a2-4587-94b6-692147c6862f req-97160301-f4eb-4292-b875-dd7c60e2518e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:41.538880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-080be791-c9a2-4587-94b6-692147c6862f req-97160301-f4eb-4292-b875-dd7c60e2518e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:41.550052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-080be791-c9a2-4587-94b6-692147c6862f req-97160301-f4eb-4292-b875-dd7c60e2518e service nova] Creating event network-vif-deleted:6d659016-703d-4823-bf45-d95574693722 for instance 4399d671-842e-43fa-b7ac-6523488f6031 on hv-cinder-85220 Aug 04 21:34:41.554875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-080be791-c9a2-4587-94b6-692147c6862f req-97160301-f4eb-4292-b875-dd7c60e2518e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Aug 04 21:34:41.555511 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 504/1004] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:41.596018 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:41.597784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:41.611342 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:41.611879 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:41.612384 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:41.613091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:41.613548 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:41.613975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:41.661353 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:41.668652 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-dcefb0c0-dd38-4fad-a3cf-496a707ec68d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1358 microversion: 2.1 time: 0.170177 Aug 04 21:34:41.678970 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 501/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:41 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:41.679483 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:41.693440 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6af1bf1c-05b3-4ff5-8765-5257c53bea6d tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1470 microversion: 2.1 time: 0.101550 Aug 04 21:34:41.701135 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 505/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:41 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:34:42.689759 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:42.690387 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:42.693158 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:42.698955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:42.699467 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:42.705552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:42.705552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:42.705552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:42.705552 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:42.721296 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:42.721916 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:42.730136 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:42.730699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:42.731062 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:42.731811 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:42.732264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:42.734173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:42.773450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:42.773882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:42.774308 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:42.774755 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lazy-loading 'fault' on Instance uuid 4399d671-842e-43fa-b7ac-6523488f6031 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:34:42.825099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:42.832808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-348f4247-c073-44cf-aa63-a0e3ff369664 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 200 len: 1308 microversion: 2.1 time: 0.115751 Aug 04 21:34:42.833383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 506/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:42 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:43.102176 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:43.109513 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-49ee81c5-0f5f-4b7b-aced-e120deccc3b5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1547 microversion: 2.1 time: 0.423739 Aug 04 21:34:43.110086 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 502/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:42 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1547 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:43.129461 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:43.130057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:43.136521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.136521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.137488 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.138081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.138546 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.138959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.270766 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:43.278934 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c1d1c2a0-8154-4f81-9c07-a87c95190eb4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1547 microversion: 2.1 time: 0.153246 Aug 04 21:34:43.279520 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 507/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:43 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:43.298526 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:43.303301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:43.304617 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Searching by: {'deleted': False, 'project_id': 'a7664cec57944fccbca1522095567ab8'} {{(pid=118550) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 21:34:43.311145 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.311669 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.312094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.312811 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.313251 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.313693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.407359 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.multi_cell_list [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118550) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 21:34:43.499423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d1a38163-1443-4675-9458-a325958d2af9 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204577 Aug 04 21:34:43.500012 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 503/1010] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Aug 4 21:34:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:43.517951 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:43.518591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:43.524571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.525048 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.525476 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.526164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.526608 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.527027 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.660667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:43.668211 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f59c1b1c-8bc8-48be-9754-f92ca898488d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1547 microversion: 2.1 time: 0.154166 Aug 04 21:34:43.668766 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 508/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:43 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:43.855240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:43.858704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: 4399d671-842e-43fa-b7ac-6523488f6031] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:43.862146 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.862623 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.863054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.863779 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:43.864312 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:43.864645 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:43.878521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] HTTP exception thrown: Instance 4399d671-842e-43fa-b7ac-6523488f6031 could not be found. Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Request method failure captured: Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 HTTP/1.1 Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DswtBSpQXkwZxvG14nVLTerFyY0DlAlQ7ytGMyLDEqVkvYdGNFeq_c3Jo3kKU3tUzBwqECelxIw-1wykOnEX7RMAcUJ2KQv1kXa4t31s5w6TH63XS6KSDV7AnuLAcgaruT2Y-ES8-zB6uRyA-ZutE-gLN5s5pdnYsC4KKFQM7ZORlk Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 76ca8c859a9c4762afbcf40fb071c188 Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426104755 Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:34:43.881208 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426104755 Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 76ca8c859a9c4762afbcf40fb071c188 Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426104755 Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-VolumesSnapshotTestJSON-1426104755-project Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: d1946505fcad422ba5416834ad66050d Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426104755-project Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 4399d671-842e-43fa-b7ac-6523488f6031 could not be found. Aug 04 21:34:43.882925 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '4399d671-842e-43fa-b7ac-6523488f6031'} Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d671-842e-43fa-b7ac-6523488f6031 could not be found. Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:34:43.883806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d671-842e-43fa-b7ac-6523488f6031 could not be found. Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d671-842e-43fa-b7ac-6523488f6031 could not be found. Aug 04 21:34:43.885144 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:34:43.887126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Returning 404 to user: Instance 4399d671-842e-43fa-b7ac-6523488f6031 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:34:43.887126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d03df3dd-3a0e-4477-a0d4-c80cecd0ba54 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031" status: 404 len: 111 microversion: 2.1 time: 0.030948 Aug 04 21:34:43.887126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 504/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:43 2022] GET /compute/v2.1/servers/4399d671-842e-43fa-b7ac-6523488f6031 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:34:48.719805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ef1e039-957f-4310-848e-d5623cc2b6fc"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:48.722120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:48.734725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:48.734725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:48.734725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:48.734725 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:48.735125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:48.735125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:48.735125 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=93 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:49.367355 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-579669f7-a3df-4597-b24a-366456a3e077 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651295 Aug 04 21:34:49.368045 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 509/1013] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:34:48 2022] POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:53.442591 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1558696155", "imageRef": "9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4", "flavorRef": "452", "networks": [{"uuid": "b2c4b344-d035-4c29-8358-4f084976afa9"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:53.451904 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:53.498108 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] validate_networks() for [('b2c4b344-d035-4c29-8358-4f084976afa9', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:34:53.870255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=18 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:53.878940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:34:53.879384 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:34:53.879863 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:34:53.880273 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:34:53.881867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:34:53.890523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:53.891006 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:53.891514 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:53.892254 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:53.892715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:53.893140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:53.910646 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Getting quotas for project 76ca8c859a9c4762afbcf40fb071c188. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:34:53.914659 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Getting quotas for user d1946505fcad422ba5416834ad66050d and project 76ca8c859a9c4762afbcf40fb071c188. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:34:53.926977 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:34:53.928809 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f6f61ce-95fa-4fb0-a4f8-b62ad6dbd9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:34:54.085734 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-db3374cd-4cb2-419e-a7ae-beb34cd86d12 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646924 Aug 04 21:34:54.086547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 505/1014] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:34:54.098789 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-bad4abcc-2883-4421-8e88-dc98d3eb1520 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:54.099689 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-bad4abcc-2883-4421-8e88-dc98d3eb1520 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:54.101721 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:54.156607 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-bad4abcc-2883-4421-8e88-dc98d3eb1520 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:54.163878 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-bad4abcc-2883-4421-8e88-dc98d3eb1520 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1219 microversion: 2.1 time: 0.069999 Aug 04 21:34:54.164458 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 510/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:54 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:55.185165 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:55.185796 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:55.194626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:55.195110 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:55.195704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:55.196450 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:55.196905 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:55.201285 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:55.263616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:55.271244 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6cca1e31-f4f4-44ef-b648-1c30a6e734a3 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1215 microversion: 2.1 time: 0.090641 Aug 04 21:34:55.271832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 506/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:55 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:56.293680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:56.294290 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:56.300813 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:56.301292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:56.301731 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:56.302414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:56.302873 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:56.303297 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:56.369928 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:56.377464 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-405f86b7-5fd7-448b-a358-3aacab1c0a8a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1279 microversion: 2.1 time: 0.088711 Aug 04 21:34:56.378047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 511/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:56 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:56.982901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:56.982901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:56.987862 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:56.988401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:56.988836 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:56.989525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:56.989976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:56.990396 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:57.223158 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:57.232695 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-fb99d77e-7651-432e-a676-c6585f8e7c33 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1593 microversion: 2.1 time: 0.256545 Aug 04 21:34:57.233336 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 507/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:56 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1593 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:57.411791 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:57.418400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:57.419990 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:57.420475 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:57.420906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:57.421597 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:57.422040 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:57.422460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:57.613091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:57.622729 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-78415ea8-3604-4622-887b-3470e80a7925 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.218711 Aug 04 21:34:57.623651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 512/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:57 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:58.050304 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-bb91e785-440e-4594-b771-af0f948f7b45 req-862bf3e3-61bd-4ea2-8b4f-60837c152bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8f03237-d910-4df0-9c42-5ae8509d26cc", "tag": "7ebfa0c5-0270-495e-9580-eb31e7648d6a"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:58.061206 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-bb91e785-440e-4594-b771-af0f948f7b45 req-862bf3e3-61bd-4ea2-8b4f-60837c152bed service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:58.061780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-bb91e785-440e-4594-b771-af0f948f7b45 req-862bf3e3-61bd-4ea2-8b4f-60837c152bed service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:58.062276 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-bb91e785-440e-4594-b771-af0f948f7b45 req-862bf3e3-61bd-4ea2-8b4f-60837c152bed service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:58.075383 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-bb91e785-440e-4594-b771-af0f948f7b45 req-862bf3e3-61bd-4ea2-8b4f-60837c152bed service nova] Creating event network-changed:7ebfa0c5-0270-495e-9580-eb31e7648d6a for instance b8f03237-d910-4df0-9c42-5ae8509d26cc on hv-cinder-85220 Aug 04 21:34:58.080940 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-bb91e785-440e-4594-b771-af0f948f7b45 req-862bf3e3-61bd-4ea2-8b4f-60837c152bed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035367 Aug 04 21:34:58.081889 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 508/1020] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:34:58.644661 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:34:58.645357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:34:58.651805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:58.655497 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:58.655497 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:58.655497 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:58.655497 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:58.655975 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:59.194637 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:34:59.203148 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2b2a5312-823a-4b9c-a135-44cd5ff9d843 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.562641 Aug 04 21:34:59.203773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 513/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:34:58 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:34:59.639912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-ccb7d6a9-2fbd-4124-ae38-ee4fa80d2a0a req-10e910c4-4c64-46dc-b2b9-8e3f9c18735d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:34:59.650527 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-ccb7d6a9-2fbd-4124-ae38-ee4fa80d2a0a req-10e910c4-4c64-46dc-b2b9-8e3f9c18735d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:34:59.651277 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-ccb7d6a9-2fbd-4124-ae38-ee4fa80d2a0a req-10e910c4-4c64-46dc-b2b9-8e3f9c18735d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:34:59.651736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-ccb7d6a9-2fbd-4124-ae38-ee4fa80d2a0a req-10e910c4-4c64-46dc-b2b9-8e3f9c18735d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:34:59.663089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-ccb7d6a9-2fbd-4124-ae38-ee4fa80d2a0a req-10e910c4-4c64-46dc-b2b9-8e3f9c18735d service nova] Creating event network-changed:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:34:59.669466 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-ccb7d6a9-2fbd-4124-ae38-ee4fa80d2a0a req-10e910c4-4c64-46dc-b2b9-8e3f9c18735d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 Aug 04 21:34:59.670050 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 509/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:00.226330 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:00.227891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:00.236188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:00.236801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:00.237383 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:00.238087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:00.238545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:00.238953 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:00.395159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:00.402814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cb273092-f78b-4b2a-aca4-13e5f26727fe tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.181476 Aug 04 21:35:00.403404 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 514/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:00 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:01.425025 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:01.425842 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:01.432472 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:01.432955 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:01.433389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:01.434080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:01.434540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:01.434961 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:01.579401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:01.586887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-ea9aa612-e519-4fde-a897-ef4bac2288c9 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.166497 Aug 04 21:35:01.588061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 510/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:01 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:02.087030 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-940091674"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:02.089829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:02.094070 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.094556 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.094989 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.095717 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.096257 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.096596 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.227021 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.network.security_group_api [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Adding security group 9525443f-db16-40c6-8b0b-a6385ae0d665 to port 54475934-f28a-402f-8401-18ce04aba711 Aug 04 21:35:02.608761 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:02.609339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:02.616042 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.616536 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.617247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.618879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.620530 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.620976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.637582 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a124204e-be5f-421f-8d6d-73bc12948e66 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/action" status: 202 len: 0 microversion: 2.1 time: 0.554813 Aug 04 21:35:02.639957 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 515/1025] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:35:02 2022] POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:35:02.652319 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:02.653601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:02.664688 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.667183 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.667931 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.668658 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.669129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.669552 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.793922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:02.800414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4fc31aaf-20a2-41ae-83dd-30c96fc2b1be tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.196878 Aug 04 21:35:02.801003 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 511/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:02 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:02.806136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-347018d1-2135-48af-af29-4a635a4a8187 req-e444be5c-c258-40c6-acf3-4a3c92316bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:02.815971 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-347018d1-2135-48af-af29-4a635a4a8187 req-e444be5c-c258-40c6-acf3-4a3c92316bf5 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:02.816732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-347018d1-2135-48af-af29-4a635a4a8187 req-e444be5c-c258-40c6-acf3-4a3c92316bf5 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:02.817326 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-347018d1-2135-48af-af29-4a635a4a8187 req-e444be5c-c258-40c6-acf3-4a3c92316bf5 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:02.833611 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-347018d1-2135-48af-af29-4a635a4a8187 req-e444be5c-c258-40c6-acf3-4a3c92316bf5 service nova] Creating event network-changed:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:35:02.840454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-347018d1-2135-48af-af29-4a635a4a8187 req-e444be5c-c258-40c6-acf3-4a3c92316bf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037584 Aug 04 21:35:02.841068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 512/1027] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:02.885504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:02.895253 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-38e32e3c-9655-40a3-9863-3d201ce06bc8 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1758 microversion: 2.1 time: 0.249096 Aug 04 21:35:02.898730 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 516/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:02 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1758 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:03.825046 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:03.825715 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:03.832412 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:03.832890 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:03.833318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:03.834022 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:03.834446 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:03.834862 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:03.901704 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:03.921490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:03.968747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:03.976397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-51610f5e-f2d4-4471-8de0-4560defcc856 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.156088 Aug 04 21:35:03.976966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 513/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:03 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:04.414590 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-a12e2684-3ff1-4be6-ad60-0da784f1b420 req-95ad4114-59b2-4913-abf8-f976171835ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f03237-d910-4df0-9c42-5ae8509d26cc", "name": "network-vif-plugged", "status": "completed", "tag": "7ebfa0c5-0270-495e-9580-eb31e7648d6a"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:04.421820 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:04.425672 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-a12e2684-3ff1-4be6-ad60-0da784f1b420 req-95ad4114-59b2-4913-abf8-f976171835ff service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:04.426142 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-a12e2684-3ff1-4be6-ad60-0da784f1b420 req-95ad4114-59b2-4913-abf8-f976171835ff service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:04.426571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-a12e2684-3ff1-4be6-ad60-0da784f1b420 req-95ad4114-59b2-4913-abf8-f976171835ff service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:04.437985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-a12e2684-3ff1-4be6-ad60-0da784f1b420 req-95ad4114-59b2-4913-abf8-f976171835ff service nova] Creating event network-vif-plugged:7ebfa0c5-0270-495e-9580-eb31e7648d6a for instance b8f03237-d910-4df0-9c42-5ae8509d26cc on hv-cinder-85220 Aug 04 21:35:04.442935 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-a12e2684-3ff1-4be6-ad60-0da784f1b420 req-95ad4114-59b2-4913-abf8-f976171835ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 Aug 04 21:35:04.443576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 517/1030] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:05.000545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:05.001133 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:05.008102 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:05.008580 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:05.009009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:05.009712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:05.010769 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:05.011157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:05.142908 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:05.150386 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-89d62f33-df89-420c-aaab-f69e635ea55a tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.154353 Aug 04 21:35:05.150956 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 514/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:04 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:06.172775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:06.173600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:06.180356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:06.180826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:06.181246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:06.181921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:06.182361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:06.182775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:06.429767 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:06.438540 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-453f02eb-c926-4b2c-955f-c3916acdbcdb tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1319 microversion: 2.1 time: 0.271220 Aug 04 21:35:06.439120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 518/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:06 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:07.459403 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:07.459998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:07.466729 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:07.467192 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:07.467641 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:07.468319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:07.468755 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:07.469167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:07.599149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:07.606714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-b1333ac0-a5d1-4564-9d4f-39fdcd5e7911 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1507 microversion: 2.1 time: 0.151154 Aug 04 21:35:07.607278 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 515/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:07 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:07.631829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fa006e6-0cd6-49fe-9ee5-3f62a861a3f3", "device": "/dev/sdb"}} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:07.634709 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:07.641796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:07.642270 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:07.642701 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:07.643414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:07.643923 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:07.644340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:08.228885 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4cec950f-fe43-4d6f-9a22-5a9c8ef6aa0c tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "POST /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600957 Aug 04 21:35:08.229591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 519/1034] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Aug 4 21:35:07 2022] POST /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc/os-volume_attachments => generated 194 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:16.859502 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:16.861655 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:16.863903 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:16.868638 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:16.869114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:16.869543 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:16.870230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:16.870679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:16.871100 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:17.069299 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1a81f6ad-4c69-4185-ad10-cc80af00cbea tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/action" status: 202 len: 0 microversion: 2.1 time: 0.213347 Aug 04 21:35:17.073154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 516/1035] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:35:16 2022] POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:35:17.080671 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:17.081513 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:17.087743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:17.088224 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:17.088656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:17.089371 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:17.089825 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:17.090247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:17.234551 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:17.242511 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-02878c33-0faa-4b98-995b-bac761096ef4 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1750 microversion: 2.1 time: 0.167566 Aug 04 21:35:17.243067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 520/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:17 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:18.265581 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:18.266245 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:18.272296 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:18.272770 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:18.273195 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:18.273875 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:18.274319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:18.274740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:18.482616 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:18.492457 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-d6c70b95-4e68-4394-aa58-5675ac62bc3a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1750 microversion: 2.1 time: 0.232317 Aug 04 21:35:18.493229 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 517/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:18 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1750 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:19.338798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:35:19.341270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Thu Aug 4 21:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:35:19.518035 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:19.518639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:19.525190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:19.525666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:19.526096 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:19.526778 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:19.527226 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:19.527673 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:19.530271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:19.671690 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:19.679724 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-777a8219-75b6-4b44-a879-630a3595d957 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1750 microversion: 2.1 time: 0.166194 Aug 04 21:35:19.680296 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 521/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:19 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:20.702020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:20.702674 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:20.709615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:20.710095 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:20.710525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:20.711213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:20.711696 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:20.712115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:20.861868 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:20.869831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c70ccf7d-4bf9-4ec0-991c-d8f0957d605b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.171914 Aug 04 21:35:20.870381 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 518/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:20 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:21.890711 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:21.891381 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:21.897891 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:21.898367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:21.898793 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:21.899521 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:21.899971 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:21.900389 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:22.045071 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:22.053593 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8faf6337-3036-4a8e-b6b9-646ca6401a71 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.166767 Aug 04 21:35:22.054165 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 522/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:21 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:23.076712 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:23.077242 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:23.083747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:23.084215 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:23.084649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:23.085321 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:23.085837 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:23.086248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:23.241260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:23.249093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-244b14c9-656a-424b-a29e-f38f638e781a tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.176802 Aug 04 21:35:23.249650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 519/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:23 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:24.269763 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:24.270367 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:24.276656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:24.277123 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:24.277547 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:24.278220 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:24.278665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:24.279078 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:24.424500 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:24.433145 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-92e44d60-89c6-420e-89b3-a4261093f49b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.167220 Aug 04 21:35:24.433713 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 523/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:24 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:25.454554 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:25.513653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:25.513653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:25.513653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:25.513653 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:25.514089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:25.514089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:25.514089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:25.514089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:25.615155 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:25.622999 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a1d5ce10-d5ff-453f-97d1-1a63f1b7e059 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.172346 Aug 04 21:35:25.623595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 520/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:25 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:26.645567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:26.646164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:26.648400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=30 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:26.653097 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:26.653566 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:26.654023 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:26.654698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:26.655139 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:26.655576 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:26.802006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:26.810153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-4d940335-3749-4bc1-8e8d-fafc3b29dd14 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.169114 Aug 04 21:35:26.810707 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 524/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:26 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:27.796329 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:27.796919 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:27.803517 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:27.804248 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:27.804683 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:27.805371 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:27.805821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:27.806240 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:27.830301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:35:27.832525 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:27.833126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:27.839674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:27.840149 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:27.840575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:27.841252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:27.841693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:27.842104 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:28.006327 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:28.014442 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b2473f41-fc3d-4d6c-9557-d596b1841499 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.186278 Aug 04 21:35:28.015001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 525/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:27 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:35:28.110723 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-94cd2615-c682-441d-90b0-299b935cf4b1 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 204 len: 0 microversion: 2.1 time: 0.318051 Aug 04 21:35:28.111093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 521/1046] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:35:27 2022] DELETE /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:35:28.119906 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:28.120455 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:28.126358 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:28.127388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:28.127388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:28.128129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:28.128600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:28.130900 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:28.267293 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:28.275616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-10470927-68a2-4cf5-a9b5-24f1f3560dbe tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1576 microversion: 2.1 time: 0.159717 Aug 04 21:35:28.276221 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 526/1047] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:28 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:35:28.452488 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:28.453061 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:28.459018 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:28.459528 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:28.459960 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:28.460641 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:28.461083 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:28.461525 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:28.550384 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lazy-loading 'services' on Instance uuid b8f03237-d910-4df0-9c42-5ae8509d26cc {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:35:28.823260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-00653a7b-558f-4fe4-883e-33d546e3a271 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc/os-volume_attachments/3fa006e6-0cd6-49fe-9ee5-3f62a861a3f3" status: 202 len: 0 microversion: 2.1 time: 0.375870 Aug 04 21:35:28.824464 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 522/1048] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:35:28 2022] DELETE /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc/os-volume_attachments/3fa006e6-0cd6-49fe-9ee5-3f62a861a3f3 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:35:29.037870 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:29.038414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:29.044811 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:29.045292 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:29.045730 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:29.046450 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:29.046871 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:29.047304 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:29.193808 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:29.202103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ea4d821d-ce1b-473e-a279-13cf029b7132 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.168752 Aug 04 21:35:29.202676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 527/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:29 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:29.296639 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:29.297247 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:29.304270 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:29.304757 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:29.305185 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:29.305867 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:29.306307 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:29.306725 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:29.445050 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:29.453168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-451cb3ce-783e-4a10-b3dc-e98aeeaae9cb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1576 microversion: 2.1 time: 0.160907 Aug 04 21:35:29.453952 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 523/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:29 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:30.225377 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:30.226559 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:30.233472 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:30.233965 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:30.234436 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:30.235144 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:30.235623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:30.236052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:30.388796 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:30.397698 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-217fc285-5ac5-4414-95ae-5017ed2971db tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1755 microversion: 2.1 time: 0.177248 Aug 04 21:35:30.399119 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 528/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:30 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:30.474681 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:30.475283 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:30.482037 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:30.482523 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:30.482964 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:30.483753 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:30.484205 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:30.484628 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:30.861107 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:30.874524 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-30016d62-4d85-46bc-9318-5368e742101e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1576 microversion: 2.1 time: 0.400148 Aug 04 21:35:30.875135 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 524/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:30 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1576 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:31.018840 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:31.019419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:31.025941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.027223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.027223 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.027542 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.027988 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.028415 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.053036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:35:31.207740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-3fdf831f-e7cc-43b2-9aae-380f403da527 req-83786ad3-1293-4620-b1f3-57e298d1dc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b166cb-3712-4ff3-bed4-ec30a537e1d2", "name": "network-vif-deleted", "tag": "207ed98e-cfbe-491b-9fc8-1422019f3d94"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:31.221049 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3fdf831f-e7cc-43b2-9aae-380f403da527 req-83786ad3-1293-4620-b1f3-57e298d1dc3f service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.222106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3fdf831f-e7cc-43b2-9aae-380f403da527 req-83786ad3-1293-4620-b1f3-57e298d1dc3f service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.222106 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-3fdf831f-e7cc-43b2-9aae-380f403da527 req-83786ad3-1293-4620-b1f3-57e298d1dc3f service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.236076 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-3fdf831f-e7cc-43b2-9aae-380f403da527 req-83786ad3-1293-4620-b1f3-57e298d1dc3f service nova] Creating event network-vif-deleted:207ed98e-cfbe-491b-9fc8-1422019f3d94 for instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 on hv-cinder-85220 Aug 04 21:35:31.241975 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-3fdf831f-e7cc-43b2-9aae-380f403da527 req-83786ad3-1293-4620-b1f3-57e298d1dc3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037727 Aug 04 21:35:31.253697 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 525/1053] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:35:31.345131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7de92c1e-4138-4491-81ce-776e86a92b19 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 204 len: 0 microversion: 2.1 time: 0.329902 Aug 04 21:35:31.345773 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 529/1054] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:35:31 2022] DELETE /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 21:35:31.358301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:31.359004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:31.366676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.367161 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.367658 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.368399 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.368855 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.369338 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.419630 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:31.420651 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:31.429280 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.430393 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.430985 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.431619 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.432263 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.432969 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.551009 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:31.563587 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-4e44717c-c921-465b-b1d1-7df08877ae08 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1513 microversion: 2.1 time: 0.209585 Aug 04 21:35:31.577920 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 526/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:31 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:31.604634 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:31.612505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-d4788b63-4f2f-4693-b5e2-55f389b52026 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1758 microversion: 2.1 time: 0.197604 Aug 04 21:35:31.613074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 530/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:31 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:35:31.896151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:31.896754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:31.902798 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.903289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.903751 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.904443 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:31.904897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:31.905328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:31.971706 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:31.979808 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-39dc24a3-91fa-4387-8fa3-b1054e0e4829 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1225 microversion: 2.1 time: 0.087521 Aug 04 21:35:31.980380 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 527/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:31 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:32.585889 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:32.586495 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:32.592829 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:32.593309 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:32.593738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:32.594414 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:32.594863 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:32.595279 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:32.727001 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:32.734790 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-522d7e97-5cdc-475c-9f11-1d363a9b4cf5 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1513 microversion: 2.1 time: 0.153410 Aug 04 21:35:32.744507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 531/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:32 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:33.003985 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:33.004593 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:33.011680 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:33.012163 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:33.012655 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:33.013349 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:33.013803 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:33.014224 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:33.088512 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:33.098817 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-5c67de10-2b86-4742-ab8f-1667ca88aceb tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 200 len: 1225 microversion: 2.1 time: 0.098478 Aug 04 21:35:33.099853 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 528/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:32 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:33.538260 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-18247507-604a-49e6-922d-35cd8c7ca677 req-95cf8f9c-c0e1-44af-b4dc-78da9ef24db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8f03237-d910-4df0-9c42-5ae8509d26cc", "name": "network-vif-deleted", "tag": "7ebfa0c5-0270-495e-9580-eb31e7648d6a"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:33.539954 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-18247507-604a-49e6-922d-35cd8c7ca677 req-95cf8f9c-c0e1-44af-b4dc-78da9ef24db8 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:33.540432 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-18247507-604a-49e6-922d-35cd8c7ca677 req-95cf8f9c-c0e1-44af-b4dc-78da9ef24db8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:33.540857 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-18247507-604a-49e6-922d-35cd8c7ca677 req-95cf8f9c-c0e1-44af-b4dc-78da9ef24db8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:33.552398 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-18247507-604a-49e6-922d-35cd8c7ca677 req-95cf8f9c-c0e1-44af-b4dc-78da9ef24db8 service nova] Creating event network-vif-deleted:7ebfa0c5-0270-495e-9580-eb31e7648d6a for instance b8f03237-d910-4df0-9c42-5ae8509d26cc on hv-cinder-85220 Aug 04 21:35:33.558613 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-18247507-604a-49e6-922d-35cd8c7ca677 req-95cf8f9c-c0e1-44af-b4dc-78da9ef24db8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032140 Aug 04 21:35:33.567774 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 532/1060] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:33.755656 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:33.756178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:33.762142 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:33.762622 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:33.763052 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:33.763766 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:33.764418 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:33.764844 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:33.830644 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1946505fcad422ba5416834ad66050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ca8c859a9c4762afbcf40fb071c188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:33.839736 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f82380b8-b7a6-44c9-91f2-17166cb5087b tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 200 len: 1304 microversion: 2.1 time: 0.087988 Aug 04 21:35:33.840309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 529/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:33 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:34.132800 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:34.133403 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:34.139565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:34.140038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:34.140466 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:34.141142 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:34.141591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:34.142014 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:34.155162 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] HTTP exception thrown: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Request method failure captured: Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 HTTP/1.1 Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Drh_e6ZBrUU_gq_HBfcIqZL4VitxJsQlez6ywTr0UBSyTA1z9ZFCouC9kXnk-07ogpfR_Kguiog2MbpEOYeCIVbwxg6IK2KSGGOIp0ezC9lRrUge5SMZmhHXXKOOik98IOD_nohm_C8z_IDv8hbXl41smBPFCVEyoArWL9gbFaapHM Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:35:34.156913 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-TestVolumeBootPattern-349171386 Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b665d491470f4a0b95c13f51e19d2046 Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:35:34.158591 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '71b166cb-3712-4ff3-bed4-ec30a537e1d2'} Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:35:34.159781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:35:34.161453 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.163504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Returning 404 to user: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:35:34.163504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-629cf3e3-3ecc-41ac-b80a-1fe6cb4bc0d7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 404 len: 111 microversion: 2.1 time: 0.030260 Aug 04 21:35:34.163504 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 533/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:34 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:35:34.265661 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-943452744", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320534295", "security_groups": [{"name": "tempest-secgroup-smoke-1205312341"}], "block_device_mapping_v2": [{"uuid": "0984b370-8efe-4400-ac30-73e904e98e09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59d113d5-0697-4e33-8c52-349214c72cf5"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:34.384432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] validate_networks() for [('59d113d5-0697-4e33-8c52-349214c72cf5', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:35:34.775263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:35:34.775714 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:35:34.776184 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:35:34.776589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:35:34.776994 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:35:34.785550 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:34.786030 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:34.786461 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:34.787221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:34.787703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:34.788123 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:34.804228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:35:34.808124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for user b665d491470f4a0b95c13f51e19d2046 and project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:35:34.860795 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:34.861400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] [instance: b8f03237-d910-4df0-9c42-5ae8509d26cc] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:34.865786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:35:34.868114 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0984b370-8efe-4400-ac30-73e904e98e09',volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:35:34.868567 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:34.869052 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:34.869520 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:34.870214 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:34.870666 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:34.871494 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:34.885759 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] HTTP exception thrown: Instance b8f03237-d910-4df0-9c42-5ae8509d26cc could not be found. Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Request method failure captured: Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc HTTP/1.1 Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DswtBSpQXkwZxvG14nVLTerFyY0DlAlQ7ytGMyLDEqVkvYdGNFeq_c3Jo3kKU3tUzBwqECelxIw-1wykOnEX7RMAcUJ2KQv1kXa4t31s5w6TH63XS6KSDV7AnuLAcgaruT2Y-ES8-zB6uRyA-ZutE-gLN5s5pdnYsC4KKFQM7ZORlk Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 76ca8c859a9c4762afbcf40fb071c188 Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426104755 Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:35:34.887346 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/76ca8c859a9c4762afbcf40fb071c188"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426104755 Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 76ca8c859a9c4762afbcf40fb071c188 Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426104755 Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-VolumesSnapshotTestJSON-1426104755-project Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: d1946505fcad422ba5416834ad66050d Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426104755-project Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance b8f03237-d910-4df0-9c42-5ae8509d26cc could not be found. Aug 04 21:35:34.889408 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'b8f03237-d910-4df0-9c42-5ae8509d26cc'} Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f03237-d910-4df0-9c42-5ae8509d26cc could not be found. Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:35:34.890573 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f03237-d910-4df0-9c42-5ae8509d26cc could not be found. Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f03237-d910-4df0-9c42-5ae8509d26cc could not be found. Aug 04 21:35:34.893250 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:35:34.896129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] Returning 404 to user: Instance b8f03237-d910-4df0-9c42-5ae8509d26cc could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:35:34.896129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-311cde64-fe7c-4b47-8bf7-bebd83dd5dd8 tempest-VolumesSnapshotTestJSON-1426104755 tempest-VolumesSnapshotTestJSON-1426104755-project] 10.222.0.25 "GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc" status: 404 len: 111 microversion: 2.1 time: 0.031726 Aug 04 21:35:34.896129 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 534/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:34 2022] GET /compute/v2.1/servers/b8f03237-d910-4df0-9c42-5ae8509d26cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 21:35:35.466504 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-28e3c560-2d68-4408-8eb2-107442895745 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205136 Aug 04 21:35:35.473251 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 530/1064] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:35:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:35:35.478805 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-bdb10d36-1e89-4235-b50e-1c001075e982 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:35.479638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-bdb10d36-1e89-4235-b50e-1c001075e982 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:35.559485 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-bdb10d36-1e89-4235-b50e-1c001075e982 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:35.567101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-bdb10d36-1e89-4235-b50e-1c001075e982 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1094 microversion: 2.1 time: 0.092702 Aug 04 21:35:35.567934 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 535/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:35 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:36.588459 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:36.589071 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:36.595468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:36.595967 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:36.596394 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:36.597124 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:36.597753 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:36.598264 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:36.661744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:36.670122 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-80606d9a-94e1-4ee5-9da7-956671b90900 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1144 microversion: 2.1 time: 0.086509 Aug 04 21:35:36.670688 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 531/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:36 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:37.690415 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:37.691102 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:37.699261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:37.699775 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:37.700209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:37.700883 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:37.701334 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:37.701786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:37.761749 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:37.769196 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8e89557c-1f8e-4f34-9e8e-4b6be56d926a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1200 microversion: 2.1 time: 0.082851 Aug 04 21:35:37.769758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 536/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:37 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:38.790210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:38.790812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:38.796828 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:38.797312 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:38.797749 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:38.798440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:38.798897 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:38.799334 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:38.864387 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:38.872993 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-12a29e9a-1d66-45fc-ad7f-751c5146b07c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1200 microversion: 2.1 time: 0.086946 Aug 04 21:35:38.873567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 532/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:38 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:39.894088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:39.894694 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:39.901517 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:39.901993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:39.902417 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:39.903088 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:39.903565 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:39.903982 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:39.968726 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:39.976087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6b66ab8e-a195-4415-aa80-45cd767aa6df tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1200 microversion: 2.1 time: 0.085875 Aug 04 21:35:39.976646 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 537/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:39 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:40.997693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:40.998468 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:41.007913 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:41.008671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:41.009200 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:41.009989 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:41.010947 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:41.011790 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:41.205687 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:41.214163 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-786146fe-84e9-40ae-aeec-d95b3e967757 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1278 microversion: 2.1 time: 0.220735 Aug 04 21:35:41.214808 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 533/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:40 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:42.023447 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-e30dbe17-47c0-401d-b2e9-e5eb5827372c req-d306f5ee-b589-4a0a-8876-6f0d083a1cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd682ac7-5a28-42c3-8042-eaa971488aec", "tag": "ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:42.037855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-e30dbe17-47c0-401d-b2e9-e5eb5827372c req-d306f5ee-b589-4a0a-8876-6f0d083a1cd6 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:42.038246 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-e30dbe17-47c0-401d-b2e9-e5eb5827372c req-d306f5ee-b589-4a0a-8876-6f0d083a1cd6 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:42.038678 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-e30dbe17-47c0-401d-b2e9-e5eb5827372c req-d306f5ee-b589-4a0a-8876-6f0d083a1cd6 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:42.057062 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-e30dbe17-47c0-401d-b2e9-e5eb5827372c req-d306f5ee-b589-4a0a-8876-6f0d083a1cd6 service nova] Creating event network-changed:ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f for instance dd682ac7-5a28-42c3-8042-eaa971488aec on hv-cinder-85220 Aug 04 21:35:42.062283 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-e30dbe17-47c0-401d-b2e9-e5eb5827372c req-d306f5ee-b589-4a0a-8876-6f0d083a1cd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141178 Aug 04 21:35:42.063033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 538/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:35:42.235922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:42.236534 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:42.243670 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:42.244154 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:42.244591 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:42.245276 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:42.245731 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:42.246151 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:42.466566 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:42.473949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6e4da006-cef5-458b-8593-24f02c4f4c2e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.242092 Aug 04 21:35:42.475189 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 534/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:42 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:43.497589 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:43.498192 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:43.504190 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:43.504673 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:43.505098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:43.506382 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:43.506827 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:43.507242 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:43.643057 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:43.645596 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:43.651639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e5e08865-430d-49b2-b222-a5a1a64b476d tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.159071 Aug 04 21:35:43.652204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 539/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:43 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:44.671599 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:44.672205 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:44.679202 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:44.679709 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:44.680139 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:44.680821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:44.681263 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:44.681679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:44.795968 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:44.819444 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:44.823024 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:44.823778 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:44.826728 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8cd2c0f2-f059-4396-b888-d92c1325fae4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.158973 Aug 04 21:35:44.831850 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 535/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:44 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:45.852320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:45.852933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:45.855204 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:45.860638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:45.861164 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:45.861599 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:45.862284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:45.862728 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:45.863143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:46.007081 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:46.014331 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9a26a367-45fe-4cb7-b802-c231a149ba94 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.166662 Aug 04 21:35:46.014892 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 540/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:45 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:47.036521 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:47.037649 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:47.040494 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:47.047369 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:47.047859 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:47.048295 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:47.052226 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:47.052226 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:47.052226 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:47.184250 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:47.192252 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-70ec2d8c-0592-43a7-80a1-8a888a807695 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.159992 Aug 04 21:35:47.192808 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 536/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:47 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:48.212623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:48.213236 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:48.220230 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:48.220714 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:48.221143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:48.221843 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:48.222295 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:48.222719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:48.366178 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:48.373676 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-a20f72d7-8e5a-406a-ad75-61ea372608f2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.165027 Aug 04 21:35:48.374234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 541/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:48 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:49.394071 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:49.394680 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:49.402319 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:49.402793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:49.403347 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:49.404065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:49.404513 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:49.404980 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:49.541535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:49.549153 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-1b37aa52-3e00-45ba-acf4-99b544ea2e3e tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.159235 Aug 04 21:35:49.549708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 537/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:49 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:50.569888 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:50.570524 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:50.582419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:50.582419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:50.582419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:50.582419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:50.582817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:50.582817 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:50.707798 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:50.717120 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e8432ab9-26e2-4eb8-98b6-de0d9514c144 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.151192 Aug 04 21:35:50.717744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 542/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:50 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:51.738711 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:51.739339 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:51.746298 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:51.746780 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:51.749671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:51.749671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:51.749671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:51.749671 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:51.884389 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:51.891900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-05705c70-8476-4510-8897-b4630bf9f2ac tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.157130 Aug 04 21:35:51.892471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 538/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:51 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:52.911983 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:52.912684 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:52.918976 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:52.919719 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:52.920146 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:52.920836 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:52.921284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:52.921699 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:53.065197 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:53.073321 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8de7c007-b138-4dff-a235-01a7d7cea212 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.165235 Aug 04 21:35:53.073902 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 543/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:52 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:54.093996 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:54.094573 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:54.100901 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:54.101483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:54.102466 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:54.103147 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:54.103626 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:54.104040 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:54.242207 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:54.249533 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a7d25e7c-8a73-47f1-b707-3fdbae5d74da tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.159366 Aug 04 21:35:54.250089 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 539/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:54 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:54.471252 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-04c7dd1b-dff0-4f00-94a3-9534ece5e98d req-bb4babfe-3ab1-4ae2-9849-a624eca16f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd682ac7-5a28-42c3-8042-eaa971488aec", "name": "network-vif-plugged", "status": "completed", "tag": "ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:54.481794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-04c7dd1b-dff0-4f00-94a3-9534ece5e98d req-bb4babfe-3ab1-4ae2-9849-a624eca16f8c service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:54.482271 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-04c7dd1b-dff0-4f00-94a3-9534ece5e98d req-bb4babfe-3ab1-4ae2-9849-a624eca16f8c service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:54.482696 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-04c7dd1b-dff0-4f00-94a3-9534ece5e98d req-bb4babfe-3ab1-4ae2-9849-a624eca16f8c service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:54.494163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-04c7dd1b-dff0-4f00-94a3-9534ece5e98d req-bb4babfe-3ab1-4ae2-9849-a624eca16f8c service nova] Creating event network-vif-plugged:ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f for instance dd682ac7-5a28-42c3-8042-eaa971488aec on hv-cinder-85220 Aug 04 21:35:54.502693 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-04c7dd1b-dff0-4f00-94a3-9534ece5e98d req-bb4babfe-3ab1-4ae2-9849-a624eca16f8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033192 Aug 04 21:35:54.503305 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 544/1083] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:35:55.272098 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:55.272732 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:55.280065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:55.280545 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:55.280972 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:55.281928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:55.282376 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:55.282793 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:55.416891 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:55.424738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-249f1d3d-83da-4d42-83f3-820c509bc53c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1266 microversion: 2.1 time: 0.156473 Aug 04 21:35:55.425399 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 540/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:55 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:56.455131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:56.455131 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:56.455920 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:56.456407 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:56.456839 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:56.457532 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:56.457984 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:56.458419 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:56.593235 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:56.600786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-327884da-d6a9-4f82-af7b-a4f281277e06 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1451 microversion: 2.1 time: 0.158417 Aug 04 21:35:56.601349 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 545/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:56 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:56.620535 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:35:56.621137 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:35:56.627473 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:56.627948 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:56.628378 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:56.629054 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:56.629497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:56.629912 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:56.762447 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:35:56.769932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-8c3a2b17-d3fd-491b-9539-14c3d36786b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1451 microversion: 2.1 time: 0.153194 Aug 04 21:35:56.770509 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 541/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:35:56 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:35:58.837962 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-8f6b9629-1964-4b0c-8983-582c1b5d8065 req-4c25bbea-58a3-4ee1-92ca-bf856390b446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd682ac7-5a28-42c3-8042-eaa971488aec", "tag": "ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:35:58.844575 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:58.847968 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8f6b9629-1964-4b0c-8983-582c1b5d8065 req-4c25bbea-58a3-4ee1-92ca-bf856390b446 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:35:58.848441 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8f6b9629-1964-4b0c-8983-582c1b5d8065 req-4c25bbea-58a3-4ee1-92ca-bf856390b446 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:35:58.848915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-8f6b9629-1964-4b0c-8983-582c1b5d8065 req-4c25bbea-58a3-4ee1-92ca-bf856390b446 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:35:58.860356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-8f6b9629-1964-4b0c-8983-582c1b5d8065 req-4c25bbea-58a3-4ee1-92ca-bf856390b446 service nova] Creating event network-changed:ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f for instance dd682ac7-5a28-42c3-8042-eaa971488aec on hv-cinder-85220 Aug 04 21:35:58.865151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-8f6b9629-1964-4b0c-8983-582c1b5d8065 req-4c25bbea-58a3-4ee1-92ca-bf856390b446 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100710 Aug 04 21:35:58.865727 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 546/1087] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:04.073887 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-940091674"}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:36:04.074733 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:04.081297 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:04.081766 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:04.082191 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:04.082874 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:04.083332 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:04.083754 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:04.217526 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.network.security_group_api [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Removing security group 9525443f-db16-40c6-8b0b-a6385ae0d665 from port 54475934-f28a-402f-8401-18ce04aba711 Aug 04 21:36:04.598220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0782d821-0638-4d1b-bba7-0c9e300e8e72 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/action" status: 202 len: 0 microversion: 2.1 time: 0.528291 Aug 04 21:36:04.598962 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 542/1088] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Aug 4 21:36:04 2022] POST /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:36:04.610212 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-9f0e4233-3c57-47fe-aee4-8d9f0fd83860 req-93a9ecd6-34cc-4ddd-bcb4-ecfe3c8d3642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:36:04.622479 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-9f0e4233-3c57-47fe-aee4-8d9f0fd83860 req-93a9ecd6-34cc-4ddd-bcb4-ecfe3c8d3642 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:04.629247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-9f0e4233-3c57-47fe-aee4-8d9f0fd83860 req-93a9ecd6-34cc-4ddd-bcb4-ecfe3c8d3642 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:04.629247 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-9f0e4233-3c57-47fe-aee4-8d9f0fd83860 req-93a9ecd6-34cc-4ddd-bcb4-ecfe3c8d3642 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:04.638357 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-9f0e4233-3c57-47fe-aee4-8d9f0fd83860 req-93a9ecd6-34cc-4ddd-bcb4-ecfe3c8d3642 service nova] Creating event network-changed:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:36:04.644959 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-9f0e4233-3c57-47fe-aee4-8d9f0fd83860 req-93a9ecd6-34cc-4ddd-bcb4-ecfe3c8d3642 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041903 Aug 04 21:36:04.645562 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 547/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:06.068791 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:06.069440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:06.076196 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:06.076672 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:06.077097 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:06.077782 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:06.078228 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:06.078708 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:06.164377 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lazy-loading 'services' on Instance uuid 82a3c905-356c-4252-a915-1196dadd7222 {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:36:06.413717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-845f054f-71f7-480e-adcb-e9ed06fc74c2 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments/9ef1e039-957f-4310-848e-d5623cc2b6fc" status: 202 len: 0 microversion: 2.1 time: 0.349183 Aug 04 21:36:06.414453 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 543/1090] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:36:06 2022] DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments/9ef1e039-957f-4310-848e-d5623cc2b6fc => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 21:36:06.427249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:06.429528 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:06.436669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:06.439738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:06.439738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:06.439738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:06.439738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:06.440287 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:06.469251 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-88198747-d98f-4b8f-900e-db13af074522 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049095 Aug 04 21:36:06.469879 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 548/1091] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:36:06 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:06.661864 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-c1786714-2c64-49e1-9063-aba951db4fad req-8459273b-17d3-4727-ae1b-af09440a8f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:36:06.672953 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c1786714-2c64-49e1-9063-aba951db4fad req-8459273b-17d3-4727-ae1b-af09440a8f92 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:06.673401 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c1786714-2c64-49e1-9063-aba951db4fad req-8459273b-17d3-4727-ae1b-af09440a8f92 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:06.673850 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-c1786714-2c64-49e1-9063-aba951db4fad req-8459273b-17d3-4727-ae1b-af09440a8f92 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:06.685660 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-c1786714-2c64-49e1-9063-aba951db4fad req-8459273b-17d3-4727-ae1b-af09440a8f92 service nova] Creating event network-changed:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:36:06.692044 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-c1786714-2c64-49e1-9063-aba951db4fad req-8459273b-17d3-4727-ae1b-af09440a8f92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 Aug 04 21:36:06.692650 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 544/1092] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:07.480687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:07.482814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:07.489244 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:07.489723 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:07.490159 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:07.490863 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:07.491338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:07.491770 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:07.520933 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f44851f1-75b5-4555-9700-ad215b59224b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Aug 04 21:36:07.521474 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 549/1093] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:36:07 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:08.534501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:08.536775 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:08.542832 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:08.543309 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:08.543774 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:08.544461 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:08.544917 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:08.545340 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:08.572666 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-e2412cdc-ef1f-423f-a322-4f02447f173b tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043160 Aug 04 21:36:08.573220 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 545/1094] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:36:08 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:09.586112 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:09.590010 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:09.594706 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:09.595183 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:09.595648 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:09.596333 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:09.596784 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:09.597207 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:09.624941 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7dcd9db3-2e9e-4f5c-ae27-f1a837bccddd tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043050 Aug 04 21:36:09.625691 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 550/1095] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:36:09 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:10.636802 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:10.639045 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:10.645348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:10.645819 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:10.655068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:10.655068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:10.655068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:10.655068 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:10.676311 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-908d4f60-1b49-4ad7-912a-7cbf4e451870 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043180 Aug 04 21:36:10.676805 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 546/1096] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Aug 4 21:36:10 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 21:36:10.687196 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:10.693188 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:10.694134 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:10.694605 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:10.695032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:10.695744 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:10.696183 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:10.696612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:10.771124 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] HTTP exception thrown: Instance 82a3c905-356c-4252-a915-1196dadd7222 is not attached to volume 9ef1e039-957f-4310-848e-d5623cc2b6fc Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Request method failure captured: Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments/9ef1e039-957f-4310-848e-d5623cc2b6fc HTTP/1.1 Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7DtIVB-7WRQ2IfrC9vzTen0CxzOV_pfIYAPrwj165JyFsqWF_cIdXLGNQqMDeZriACd4gR7k1T-srEaJ1uOO3afHE-bzao-IKkQyw3jJFBv2nrzOlERewEEsF5oVvOUMBk_AHZb_Y_LH7AtHJLDlCj2tlLZ01v6PigJA3tBiM4E2hyQ Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: a7664cec57944fccbca1522095567ab8 Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-TestMinimumBasicScenario-2088965230 Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:36:10.773584 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7664cec57944fccbca1522095567ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7664cec57944fccbca1522095567ab8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7664cec57944fccbca1522095567ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7664cec57944fccbca1522095567ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-TestMinimumBasicScenario-2088965230 Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: a7664cec57944fccbca1522095567ab8 Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2088965230 Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-TestMinimumBasicScenario-2088965230-project Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: 2fc55eab88954503807d531cadd08543 Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-TestMinimumBasicScenario-2088965230-project Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:36:10.775249 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 82a3c905-356c-4252-a915-1196dadd7222 is not attached to volume 9ef1e039-957f-4310-848e-d5623cc2b6fc Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'server_id': '82a3c905-356c-4252-a915-1196dadd7222', 'id': '9ef1e039-957f-4310-848e-d5623cc2b6fc'} Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9ef1e039-957f-4310-848e-d5623cc2b6fc. Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:36:10.776549 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a3c905-356c-4252-a915-1196dadd7222 is not attached to volume 9ef1e039-957f-4310-848e-d5623cc2b6fc Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a3c905-356c-4252-a915-1196dadd7222 is not attached to volume 9ef1e039-957f-4310-848e-d5623cc2b6fc Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:36:10.778049 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Returning 404 to user: Instance 82a3c905-356c-4252-a915-1196dadd7222 is not attached to volume 9ef1e039-957f-4310-848e-d5623cc2b6fc {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:36:10.779919 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c4ab4270-cecc-44bc-839d-79b14406c786 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments/9ef1e039-957f-4310-848e-d5623cc2b6fc" status: 404 len: 154 microversion: 2.1 time: 0.091870 Aug 04 21:36:10.779919 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 551/1097] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Aug 4 21:36:10 2022] DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222/os-volume_attachments/9ef1e039-957f-4310-848e-d5623cc2b6fc => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:36:14.240740 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:14.241230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:14.247634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:14.248115 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:14.248544 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:14.249747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:14.250197 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:14.250615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:14.274922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:36:14.606745 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6bdab250-bf9b-40fd-95d3-3af5a8e881d5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 204 len: 0 microversion: 2.1 time: 0.369393 Aug 04 21:36:14.607516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 547/1098] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:36:14 2022] DELETE /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:36:14.615994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:14.616600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:14.623063 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:14.623574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:14.624005 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:14.624692 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:14.625147 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:14.625571 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:14.760117 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:36:14.768626 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-ab477a5a-dcd0-485f-b1ed-b2a61ff0962d tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1553 microversion: 2.1 time: 0.156486 Aug 04 21:36:14.769626 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 552/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:14 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:36:15.792756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:15.793615 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:15.800211 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:15.800716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:15.801175 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:15.801860 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:15.802305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:15.802717 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:15.934996 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:36:15.942617 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a5603b25-fa7c-418e-bdd1-c14be6926f90 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1553 microversion: 2.1 time: 0.154083 Aug 04 21:36:15.946462 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 548/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:15 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:36:16.964439 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:16.965048 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:16.971722 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:16.972198 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:16.972658 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:16.973340 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:16.973792 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:16.974216 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:17.105032 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:36:17.113153 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3c93c7f1-d234-41c7-852a-e2ce2e47643c tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1553 microversion: 2.1 time: 0.152634 Aug 04 21:36:17.113940 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 553/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:16 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:36:18.134939 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:18.135584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:18.138055 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:18.142664 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:18.143136 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:18.143595 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:18.144282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:18.144792 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:18.145213 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:18.149157 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:18.279838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:36:18.288013 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-34a8007f-3d88-47e9-96d7-459ef21061f5 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1553 microversion: 2.1 time: 0.156874 Aug 04 21:36:18.288584 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 549/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:18 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:36:19.303182 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-91c70af7-11c3-4e63-8aff-5c8cbab859bd req-7f00663f-3b69-485b-8d34-d3bf3ea56ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a3c905-356c-4252-a915-1196dadd7222", "name": "network-vif-deleted", "tag": "54475934-f28a-402f-8401-18ce04aba711"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:36:19.311017 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:19.315556 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:19.315743 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-91c70af7-11c3-4e63-8aff-5c8cbab859bd req-7f00663f-3b69-485b-8d34-d3bf3ea56ed3 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:19.316036 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-91c70af7-11c3-4e63-8aff-5c8cbab859bd req-7f00663f-3b69-485b-8d34-d3bf3ea56ed3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:19.322502 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:19.322769 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-91c70af7-11c3-4e63-8aff-5c8cbab859bd req-7f00663f-3b69-485b-8d34-d3bf3ea56ed3 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:19.323501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:19.323922 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:19.325065 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:19.325516 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:19.326118 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:19.336225 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=74 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:19.345380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-91c70af7-11c3-4e63-8aff-5c8cbab859bd req-7f00663f-3b69-485b-8d34-d3bf3ea56ed3 service nova] Creating event network-vif-deleted:54475934-f28a-402f-8401-18ce04aba711 for instance 82a3c905-356c-4252-a915-1196dadd7222 on hv-cinder-85220 Aug 04 21:36:19.350738 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-91c70af7-11c3-4e63-8aff-5c8cbab859bd req-7f00663f-3b69-485b-8d34-d3bf3ea56ed3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051202 Aug 04 21:36:19.352993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 554/1103] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:36:19.396589 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:36:19.404958 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3c2c9e34-b78a-4fd5-8cad-dede7facc203 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1511 microversion: 2.1 time: 0.099285 Aug 04 21:36:19.410051 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 550/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:19 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1511 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:36:20.435814 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:20.436611 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:20.443939 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:20.444424 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:20.444855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:20.445551 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:20.446002 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:20.446423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:20.476876 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:20.477352 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:20.477856 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:20.478234 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.objects.instance [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lazy-loading 'fault' on Instance uuid 82a3c905-356c-4252-a915-1196dadd7222 {{(pid=118549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:36:20.521338 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc55eab88954503807d531cadd08543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7664cec57944fccbca1522095567ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:36:20.528882 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-9e151d4e-31c4-42b7-a5fa-30e474cc9be7 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 200 len: 1348 microversion: 2.1 time: 0.097786 Aug 04 21:36:20.529440 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 555/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:20 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:36:21.550529 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:21.551094 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] [instance: 82a3c905-356c-4252-a915-1196dadd7222] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:36:21.556932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:21.557406 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:21.557838 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:21.558518 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:36:21.558965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:36:21.559454 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:36:21.572959 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] HTTP exception thrown: Instance 82a3c905-356c-4252-a915-1196dadd7222 could not be found. Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Request method failure captured: Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 HTTP/1.1 Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7DtIVB-7WRQ2IfrC9vzTen0CxzOV_pfIYAPrwj165JyFsqWF_cIdXLGNQqMDeZriACd4gR7k1T-srEaJ1uOO3afHE-bzao-IKkQyw3jJFBv2nrzOlERewEEsF5oVvOUMBk_AHZb_Y_LH7AtHJLDlCj2tlLZ01v6PigJA3tBiM4E2hyQ Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: a7664cec57944fccbca1522095567ab8 Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-TestMinimumBasicScenario-2088965230 Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:36:21.574558 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7664cec57944fccbca1522095567ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7664cec57944fccbca1522095567ab8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7664cec57944fccbca1522095567ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7664cec57944fccbca1522095567ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-TestMinimumBasicScenario-2088965230 Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: a7664cec57944fccbca1522095567ab8 Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2088965230 Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-TestMinimumBasicScenario-2088965230-project Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: 2fc55eab88954503807d531cadd08543 Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-TestMinimumBasicScenario-2088965230-project Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 82a3c905-356c-4252-a915-1196dadd7222 could not be found. Aug 04 21:36:21.576414 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '82a3c905-356c-4252-a915-1196dadd7222'} Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a3c905-356c-4252-a915-1196dadd7222 could not be found. Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:36:21.577198 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a3c905-356c-4252-a915-1196dadd7222 could not be found. Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a3c905-356c-4252-a915-1196dadd7222 could not be found. Aug 04 21:36:21.579432 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:36:21.580856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Returning 404 to user: Instance 82a3c905-356c-4252-a915-1196dadd7222 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:36:21.580856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a378a65c-ee80-453b-9055-b033227606d1 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222" status: 404 len: 111 microversion: 2.1 time: 0.030310 Aug 04 21:36:21.580856 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 551/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:36:21 2022] GET /compute/v2.1/servers/82a3c905-356c-4252-a915-1196dadd7222 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:36:21.585420 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-635a0e3b-328d-4dd9-b23e-f1aed6149643 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] Calling method '.version_select at 0x7f8e70c701f0>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:36:21.693173 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-635a0e3b-328d-4dd9-b23e-f1aed6149643 tempest-TestMinimumBasicScenario-2088965230 tempest-TestMinimumBasicScenario-2088965230-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-112280599" status: 202 len: 0 microversion: 2.1 time: 0.111456 Aug 04 21:36:21.693742 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 556/1107] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Aug 4 21:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-112280599 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:37:03.288177 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:37:03.288792 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:37:34.835932 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=5 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:34.836679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=13 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:34.840594 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-274550038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320534295", "security_groups": [{"name": "tempest-secgroup-smoke-1205312341"}], "block_device_mapping_v2": [{"uuid": "e89a3024-15f3-41ec-a2ec-ffb84c1abcec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59d113d5-0697-4e33-8c52-349214c72cf5"}]}} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:37:34.951239 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.network.neutron [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] validate_networks() for [('59d113d5-0697-4e33-8c52-349214c72cf5', None, None, None, None, None)] {{(pid=118550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 21:37:35.322221 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Flavor limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 21:37:35.322636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Image limits 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 21:37:35.323103 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Flavor pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 21:37:35.323571 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Image pref 0:0:0 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 21:37:35.323981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.virt.hardware [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 21:37:35.334080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:35.334563 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:35.334988 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:35.335747 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:35.336197 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:35.336617 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:35.352924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 21:37:35.357613 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.quota [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Getting quotas for user b665d491470f4a0b95c13f51e19d2046 and project 5b54066610f6483aa66bc27b5b2de6fe. Resources: {'instances', 'ram', 'cores'} {{(pid=118550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 21:37:35.415203 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Going to run 1 instances... {{(pid=118550) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 21:37:35.417305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e89a3024-15f3-41ec-a2ec-ffb84c1abcec',volume_size=None,volume_type=None)] {{(pid=118550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 21:37:35.796433 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-0765aac8-8200-4a95-b156-0946c68dbf75 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962089 Aug 04 21:37:35.797080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 552/1108] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Aug 4 21:37:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 21:37:35.806163 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=9 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:35.806996 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:35.813161 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-73915969-4143-4496-8ede-29dbe3f08c4c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:35.813785 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-73915969-4143-4496-8ede-29dbe3f08c4c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:35.871101 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-73915969-4143-4496-8ede-29dbe3f08c4c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:35.878181 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-73915969-4143-4496-8ede-29dbe3f08c4c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1094 microversion: 2.1 time: 0.074198 Aug 04 21:37:35.878780 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 557/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:35 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:36.899878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:36.900471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:36.906826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:36.907306 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:36.907812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:36.908608 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:36.909082 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:36.909505 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:36.971282 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:36.978845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-a866d5a7-3187-4d5f-b9c3-7e81a9db879c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1136 microversion: 2.1 time: 0.083396 Aug 04 21:37:36.979431 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 553/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:36 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:38.001151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:38.001993 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:38.008785 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:38.009269 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:38.009704 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:38.010395 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:38.010855 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:38.011284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:38.074053 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:38.082534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-b01b9289-5f84-42ab-90ad-344942609c0f tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1210 microversion: 2.1 time: 0.085903 Aug 04 21:37:38.083107 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 558/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:37 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:39.104272 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:39.105029 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:39.111786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:39.112391 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:39.112826 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:39.113515 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:39.114140 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:39.114561 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:39.308027 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:39.316031 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-aea97729-df54-4255-9278-afb5dc86c670 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.215799 Aug 04 21:37:39.316585 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 554/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:39 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:37:39.385751 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-19a93639-2e73-4c44-beb3-08b76e86f391 req-1ea0ffb7-14dc-4254-9f87-8c5045f6848e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781703f6-bec8-4e91-85db-2e6d7b879fcb", "tag": "a0a139df-b2fd-4702-bf66-8bfbccd0c913"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:37:39.396006 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-19a93639-2e73-4c44-beb3-08b76e86f391 req-1ea0ffb7-14dc-4254-9f87-8c5045f6848e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:39.396481 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-19a93639-2e73-4c44-beb3-08b76e86f391 req-1ea0ffb7-14dc-4254-9f87-8c5045f6848e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:39.396938 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-19a93639-2e73-4c44-beb3-08b76e86f391 req-1ea0ffb7-14dc-4254-9f87-8c5045f6848e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:39.408772 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-19a93639-2e73-4c44-beb3-08b76e86f391 req-1ea0ffb7-14dc-4254-9f87-8c5045f6848e service nova] Creating event network-changed:a0a139df-b2fd-4702-bf66-8bfbccd0c913 for instance 781703f6-bec8-4e91-85db-2e6d7b879fcb on hv-cinder-85220 Aug 04 21:37:39.413729 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-19a93639-2e73-4c44-beb3-08b76e86f391 req-1ea0ffb7-14dc-4254-9f87-8c5045f6848e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031866 Aug 04 21:37:39.414318 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 559/1113] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:37:40.337586 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:40.338193 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:40.345079 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:40.345557 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:40.345993 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:40.346676 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:40.347128 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:40.347570 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:40.487601 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:40.495006 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3471dd1c-0f8f-4e42-98c0-1cc5961d3220 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.161352 Aug 04 21:37:40.498121 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 555/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:40 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:41.517339 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:41.517978 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:41.524126 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:41.524600 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:41.525028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:41.525703 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:41.526151 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:41.526568 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:41.661349 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:41.668801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-60f7cb3e-b228-4322-b4a5-17402f01ebec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.156858 Aug 04 21:37:41.669356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 560/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:41 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:42.689289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:42.689903 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:42.696260 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:42.696737 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:42.697168 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:42.697851 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:42.698471 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:42.699930 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:42.837624 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:42.847149 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-986d93bf-fc38-4d66-ae81-062be84f7b85 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.161641 Aug 04 21:37:42.847763 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 556/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:42 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:43.871459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:43.872064 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:43.878987 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:43.879515 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:43.879952 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:43.880644 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:43.881098 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:43.881556 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:44.015091 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:44.023099 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-6351589e-4a47-462b-a1bc-fa7247514ef4 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.155604 Aug 04 21:37:44.023705 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 561/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:43 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:45.046827 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:45.047634 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:45.056411 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:45.056894 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:45.057328 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:45.058022 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:45.058501 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:45.058928 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:45.219774 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:45.229477 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-24b03421-f462-4e60-866c-c9cd22a00da6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.186969 Aug 04 21:37:45.230063 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 557/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:45 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:46.250638 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:46.251266 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:46.253943 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell0:SELECT=2 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:46.258880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:46.259456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:46.260024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:46.260636 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:46.261090 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:46.261516 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:46.411955 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:46.419460 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0c846160-4280-4560-b8dc-57567a6252e7 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.172686 Aug 04 21:37:46.420024 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 562/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:46 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:37:47.441497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:47.441497 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:47.449415 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=2 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:47.450352 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell0:SELECT=6 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:47.457015 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:47.457490 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:47.457956 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:47.458645 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:47.459093 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:47.459547 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:47.594483 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:47.604011 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-eec946c3-8ee5-4d2c-9a39-da8b99a0512a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.167159 Aug 04 21:37:47.604582 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 558/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:47 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:48.625601 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:48.626143 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:48.633003 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:48.633539 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:48.634047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:48.634794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:48.635328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:48.635754 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:48.776071 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:48.783616 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-7f711df4-85a0-4cfe-b972-7739b6022159 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.162496 Aug 04 21:37:48.784183 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 563/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:48 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:49.805636 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:49.806317 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:49.813410 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:49.813893 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:49.814325 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:49.815019 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:49.815503 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:49.815926 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:49.965974 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:49.974004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-98a3a82d-bce2-483c-84a3-0253229dd70a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.173441 Aug 04 21:37:49.974572 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 559/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:49 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:50.996427 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:50.997120 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:51.006992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:51.006992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:51.006992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:51.006992 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:51.007575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:51.007575 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:51.094821 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-75ccb508-aff3-4e0d-97f5-c6a19ebde1d1 req-6e802186-3c16-4066-9042-6d10f656382d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781703f6-bec8-4e91-85db-2e6d7b879fcb", "name": "network-vif-plugged", "status": "completed", "tag": "a0a139df-b2fd-4702-bf66-8bfbccd0c913"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:37:51.107908 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-75ccb508-aff3-4e0d-97f5-c6a19ebde1d1 req-6e802186-3c16-4066-9042-6d10f656382d service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:51.108636 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-75ccb508-aff3-4e0d-97f5-c6a19ebde1d1 req-6e802186-3c16-4066-9042-6d10f656382d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:51.108861 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-75ccb508-aff3-4e0d-97f5-c6a19ebde1d1 req-6e802186-3c16-4066-9042-6d10f656382d service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:51.120237 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-75ccb508-aff3-4e0d-97f5-c6a19ebde1d1 req-6e802186-3c16-4066-9042-6d10f656382d service nova] Creating event network-vif-plugged:a0a139df-b2fd-4702-bf66-8bfbccd0c913 for instance 781703f6-bec8-4e91-85db-2e6d7b879fcb on hv-cinder-85220 Aug 04 21:37:51.125328 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-75ccb508-aff3-4e0d-97f5-c6a19ebde1d1 req-6e802186-3c16-4066-9042-6d10f656382d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159774 Aug 04 21:37:51.125962 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 564/1123] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:37:51.147120 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:51.154812 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-3de84131-d90a-49ca-bbcd-7d85c0231bc9 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.162252 Aug 04 21:37:51.155393 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 560/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:50 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 21:37:52.177307 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:52.177988 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:52.184866 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:52.185356 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:52.185781 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:52.186454 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:52.186897 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:52.187310 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:52.324031 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:52.331714 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-2145d3e1-5d96-4cc9-90b3-8b9db866d680 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1266 microversion: 2.1 time: 0.159179 Aug 04 21:37:52.334786 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 565/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:52 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:53.354348 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:53.354949 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:53.361507 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:53.361981 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:53.362407 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:53.363085 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:53.363578 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:53.363998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:53.502255 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:53.510815 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-00003995-a8ee-45ff-89b1-c9a74358d6cf tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1451 microversion: 2.1 time: 0.159948 Aug 04 21:37:53.511878 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 561/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:53 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:53.531531 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:37:53.532505 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:37:53.538477 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:53.538960 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:53.539423 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:53.540110 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:53.540574 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:53.540999 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:53.671986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:37:53.679561 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-0514d36e-fc49-4dd7-a3e5-0276d413f6d0 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1451 microversion: 2.1 time: 0.151815 Aug 04 21:37:53.680067 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 566/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:37:53 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:37:55.655927 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-cc502228-36b6-4f34-be80-224b325ccbdd req-93d9e4a8-45f0-4b25-849a-5c6e538ea140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781703f6-bec8-4e91-85db-2e6d7b879fcb", "tag": "a0a139df-b2fd-4702-bf66-8bfbccd0c913"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:37:55.666186 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-cc502228-36b6-4f34-be80-224b325ccbdd req-93d9e4a8-45f0-4b25-849a-5c6e538ea140 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:37:55.666655 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-cc502228-36b6-4f34-be80-224b325ccbdd req-93d9e4a8-45f0-4b25-849a-5c6e538ea140 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:37:55.667075 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-cc502228-36b6-4f34-be80-224b325ccbdd req-93d9e4a8-45f0-4b25-849a-5c6e538ea140 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:37:55.677898 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-cc502228-36b6-4f34-be80-224b325ccbdd req-93d9e4a8-45f0-4b25-849a-5c6e538ea140 service nova] Creating event network-changed:a0a139df-b2fd-4702-bf66-8bfbccd0c913 for instance 781703f6-bec8-4e91-85db-2e6d7b879fcb on hv-cinder-85220 Aug 04 21:37:55.683261 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-cc502228-36b6-4f34-be80-224b325ccbdd req-93d9e4a8-45f0-4b25-849a-5c6e538ea140 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030888 Aug 04 21:37:55.684084 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 562/1128] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:38:39.348419 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:38:39.350338 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Thu Aug 4 21:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:39:28.760498 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_api:SELECT=22 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:39:28.762150 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG dbcounter [-] [118549] Writing DB stats nova_cell1:SELECT=46 {{(pid=118549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:39:28.764230 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4cf7247-320c-489d-bcd9-d90c6836537b] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 21:39:28.767400 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:28.780665 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:28.780892 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-9eebaf97-328a-45e7-b73f-13d255cb64b8 req-d58ecece-b7da-40ba-afc4-2f5e382b1aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781703f6-bec8-4e91-85db-2e6d7b879fcb", "tag": "a0a139df-b2fd-4702-bf66-8bfbccd0c913"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:39:28.781033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:28.781033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:28.781033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:28.781033 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:28.781388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:28.781388 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:28.785005 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:39:28.786178 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG dbcounter [-] [118550] Writing DB stats nova_cell1:SELECT=58 {{(pid=118550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:39:28.788528 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9eebaf97-328a-45e7-b73f-13d255cb64b8 req-d58ecece-b7da-40ba-afc4-2f5e382b1aa8 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:28.789320 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9eebaf97-328a-45e7-b73f-13d255cb64b8 req-d58ecece-b7da-40ba-afc4-2f5e382b1aa8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:28.790010 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-9eebaf97-328a-45e7-b73f-13d255cb64b8 req-d58ecece-b7da-40ba-afc4-2f5e382b1aa8 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:28.802976 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-9eebaf97-328a-45e7-b73f-13d255cb64b8 req-d58ecece-b7da-40ba-afc4-2f5e382b1aa8 service nova] Creating event network-changed:a0a139df-b2fd-4702-bf66-8bfbccd0c913 for instance 781703f6-bec8-4e91-85db-2e6d7b879fcb on hv-cinder-85220 Aug 04 21:39:28.809965 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-9eebaf97-328a-45e7-b73f-13d255cb64b8 req-d58ecece-b7da-40ba-afc4-2f5e382b1aa8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047541 Aug 04 21:39:28.814879 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 563/1129] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:39:28.817087 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Going to try to terminate instance {{(pid=118549) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:39:29.174926 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-c27ed3fc-8792-4a7c-b17d-1fe2d925a7a2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 204 len: 0 microversion: 2.1 time: 0.416636 Aug 04 21:39:29.175550 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 567/1130] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:39:28 2022] DELETE /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:39:29.184945 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:29.185927 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:29.193108 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:29.193590 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:29.194087 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:29.194786 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:29.195231 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:29.195685 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:29.343544 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:29.352060 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-67b96df9-da6d-4132-8a83-47cb75f80198 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1457 microversion: 2.1 time: 0.171542 Aug 04 21:39:29.352861 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 564/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:29 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1457 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:30.374667 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:30.375406 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:30.382848 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:30.383361 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:30.383801 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:30.384507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:30.384958 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:30.385384 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:30.523633 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:30.531058 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-20ad9849-8c3d-4c05-b0f8-2bbf5f002877 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1457 microversion: 2.1 time: 0.160757 Aug 04 21:39:30.531660 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 568/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:30 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1457 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:31.204915 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [req-636d83f5-010b-49e6-9d5e-a49ff7459dd4 req-e6ca1985-2fd9-43cc-8e0c-9dd9f0d16f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781703f6-bec8-4e91-85db-2e6d7b879fcb", "name": "network-vif-deleted", "tag": "a0a139df-b2fd-4702-bf66-8bfbccd0c913"}]} {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:39:31.216567 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-636d83f5-010b-49e6-9d5e-a49ff7459dd4 req-e6ca1985-2fd9-43cc-8e0c-9dd9f0d16f33 service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:31.217679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-636d83f5-010b-49e6-9d5e-a49ff7459dd4 req-e6ca1985-2fd9-43cc-8e0c-9dd9f0d16f33 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:31.217679 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [req-636d83f5-010b-49e6-9d5e-a49ff7459dd4 req-e6ca1985-2fd9-43cc-8e0c-9dd9f0d16f33 service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:31.229647 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4cf7247-320c-489d-bcd9-d90c6836537b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39360. Aug 04 21:39:31.231834 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.compute.server_external_events [req-636d83f5-010b-49e6-9d5e-a49ff7459dd4 req-e6ca1985-2fd9-43cc-8e0c-9dd9f0d16f33 service nova] Creating event network-vif-deleted:a0a139df-b2fd-4702-bf66-8bfbccd0c913 for instance 781703f6-bec8-4e91-85db-2e6d7b879fcb on hv-cinder-85220 Aug 04 21:39:31.236998 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [req-636d83f5-010b-49e6-9d5e-a49ff7459dd4 req-e6ca1985-2fd9-43cc-8e0c-9dd9f0d16f33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Aug 04 21:39:31.237693 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 565/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:39:31.551875 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:31.552491 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:31.559380 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:31.559834 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:31.560519 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:31.561459 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:31.562612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:31.562612 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:31.631254 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:31.637118 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-cc62c7f6-c076-429e-908a-07c6b210826a tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1225 microversion: 2.1 time: 0.089160 Aug 04 21:39:31.637680 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 569/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:31 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:32.660752 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:32.661470 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:32.667845 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:32.668318 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:32.668753 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:32.669428 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:32.669873 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:32.670305 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:32.710361 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:32.711125 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:32.711946 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:32.712744 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.objects.instance [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lazy-loading 'fault' on Instance uuid 781703f6-bec8-4e91-85db-2e6d7b879fcb {{(pid=118550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 21:39:32.755900 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:32.762807 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-f66d357c-776c-481d-b628-e4d927df7301 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 200 len: 1184 microversion: 2.1 time: 0.107929 Aug 04 21:39:32.763397 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 566/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:32 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 1184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:33.785768 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:33.786456 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 781703f6-bec8-4e91-85db-2e6d7b879fcb] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:33.792994 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:33.793477 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:33.793915 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:33.794624 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:33.795077 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:33.795534 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:33.809379 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] HTTP exception thrown: Instance 781703f6-bec8-4e91-85db-2e6d7b879fcb could not be found. Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Request method failure captured: Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb HTTP/1.1 Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Drh_e6ZBrUU_gq_HBfcIqZL4VitxJsQlez6ywTr0UBSyTA1z9ZFCouC9kXnk-07ogpfR_Kguiog2MbpEOYeCIVbwxg6IK2KSGGOIp0ezC9lRrUge5SMZmhHXXKOOik98IOD_nohm_C8z_IDv8hbXl41smBPFCVEyoArWL9gbFaapHM Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:39:33.811047 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b665d491470f4a0b95c13f51e19d2046 Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 781703f6-bec8-4e91-85db-2e6d7b879fcb could not be found. Aug 04 21:39:33.812854 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '781703f6-bec8-4e91-85db-2e6d7b879fcb'} Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781703f6-bec8-4e91-85db-2e6d7b879fcb could not be found. Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:39:33.813963 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781703f6-bec8-4e91-85db-2e6d7b879fcb could not be found. Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781703f6-bec8-4e91-85db-2e6d7b879fcb could not be found. Aug 04 21:39:33.819905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:33.821639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Returning 404 to user: Instance 781703f6-bec8-4e91-85db-2e6d7b879fcb could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:39:33.821639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-8fae7b4c-441c-4bf6-87c3-83a232a6beec tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb" status: 404 len: 111 microversion: 2.1 time: 0.030608 Aug 04 21:39:33.821639 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 570/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:33 2022] GET /compute/v2.1/servers/781703f6-bec8-4e91-85db-2e6d7b879fcb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:39:37.264631 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:37.265210 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:37.266545 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-33bee181-2981-49ce-a050-b953429be186 req-77838a2c-974f-4ceb-8056-b941e73c1cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd682ac7-5a28-42c3-8042-eaa971488aec", "tag": "ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:39:37.272458 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:37.272945 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:37.273373 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:37.274402 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:37.275059 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:37.275716 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:37.278191 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-33bee181-2981-49ce-a050-b953429be186 req-77838a2c-974f-4ceb-8056-b941e73c1cdc service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:37.278669 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-33bee181-2981-49ce-a050-b953429be186 req-77838a2c-974f-4ceb-8056-b941e73c1cdc service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:37.279133 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-33bee181-2981-49ce-a050-b953429be186 req-77838a2c-974f-4ceb-8056-b941e73c1cdc service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:37.291946 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-33bee181-2981-49ce-a050-b953429be186 req-77838a2c-974f-4ceb-8056-b941e73c1cdc service nova] Creating event network-changed:ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f for instance dd682ac7-5a28-42c3-8042-eaa971488aec on hv-cinder-85220 Aug 04 21:39:37.297562 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-33bee181-2981-49ce-a050-b953429be186 req-77838a2c-974f-4ceb-8056-b941e73c1cdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034821 Aug 04 21:39:37.298284 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 571/1137] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 21:39:37.307300 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Going to try to terminate instance {{(pid=118550) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 21:39:37.663301 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-c9460c31-b118-404f-a23e-a868a7661913 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 204 len: 0 microversion: 2.1 time: 0.402564 Aug 04 21:39:37.668738 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 567/1138] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:39:37 2022] DELETE /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 21:39:37.674622 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:37.675483 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:37.682712 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:37.683302 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:37.683826 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:37.684758 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:37.685209 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:37.685682 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:37.850900 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.policy [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118549) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:37.858874 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-3066fc47-01df-4b5e-bb1d-43e3d5a07b97 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1576 microversion: 2.1 time: 0.188552 Aug 04 21:39:37.859471 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 572/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:37 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:38.881757 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:38.882440 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:38.888910 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:38.889382 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:38.889806 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:38.890493 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:38.890966 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:38.891405 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:39.025482 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:39.033020 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-27e6b6e3-ece4-4942-8da8-fa91e8a21cc2 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1457 microversion: 2.1 time: 0.155999 Aug 04 21:39:39.033583 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 568/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:38 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:39.670887 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [req-f7c3dd6a-f59f-4c0c-b56d-16285ed49a87 req-1659d869-d02a-4071-933e-50963526d48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd682ac7-5a28-42c3-8042-eaa971488aec", "name": "network-vif-deleted", "tag": "ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f"}]} {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 21:39:39.681325 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-f7c3dd6a-f59f-4c0c-b56d-16285ed49a87 req-1659d869-d02a-4071-933e-50963526d48e service nova] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:39.685942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-f7c3dd6a-f59f-4c0c-b56d-16285ed49a87 req-1659d869-d02a-4071-933e-50963526d48e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:39.685942 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [req-f7c3dd6a-f59f-4c0c-b56d-16285ed49a87 req-1659d869-d02a-4071-933e-50963526d48e service nova] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:39.693366 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.compute.server_external_events [req-f7c3dd6a-f59f-4c0c-b56d-16285ed49a87 req-1659d869-d02a-4071-933e-50963526d48e service nova] Creating event network-vif-deleted:ecbdeba4-98c5-48a3-b4b5-d56fe2a4291f for instance dd682ac7-5a28-42c3-8042-eaa971488aec on hv-cinder-85220 Aug 04 21:39:39.698264 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [req-f7c3dd6a-f59f-4c0c-b56d-16285ed49a87 req-1659d869-d02a-4071-933e-50963526d48e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031152 Aug 04 21:39:39.699038 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 573/1141] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Aug 4 21:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 21:39:40.054080 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:40.054785 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:40.061858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:40.062423 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:40.062939 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:40.063756 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:40.064287 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:40.064789 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:40.132475 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.policy [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b665d491470f4a0b95c13f51e19d2046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b54066610f6483aa66bc27b5b2de6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118550) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 21:39:40.139924 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-7b6eb2c7-39cc-4928-bcd1-7ed61dda80b6 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 200 len: 1225 microversion: 2.1 time: 0.089726 Aug 04 21:39:40.140476 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 569/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:40 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 21:39:41.162074 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:41.162761 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: dd682ac7-5a28-42c3-8042-eaa971488aec] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:41.169623 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:41.170245 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:41.170687 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:41.171578 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:41.172028 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:41.172445 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:41.186904 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] HTTP exception thrown: Instance dd682ac7-5a28-42c3-8042-eaa971488aec could not be found. Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Request method failure captured: Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec HTTP/1.1 Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Drh_e6ZBrUU_gq_HBfcIqZL4VitxJsQlez6ywTr0UBSyTA1z9ZFCouC9kXnk-07ogpfR_Kguiog2MbpEOYeCIVbwxg6IK2KSGGOIp0ezC9lRrUge5SMZmhHXXKOOik98IOD_nohm_C8z_IDv8hbXl41smBPFCVEyoArWL9gbFaapHM Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:39:41.193921 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b665d491470f4a0b95c13f51e19d2046 Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance dd682ac7-5a28-42c3-8042-eaa971488aec could not be found. Aug 04 21:39:41.195662 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': 'dd682ac7-5a28-42c3-8042-eaa971488aec'} Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd682ac7-5a28-42c3-8042-eaa971488aec could not be found. Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:39:41.197080 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd682ac7-5a28-42c3-8042-eaa971488aec could not be found. Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd682ac7-5a28-42c3-8042-eaa971488aec could not be found. Aug 04 21:39:41.198653 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.200385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Returning 404 to user: Instance dd682ac7-5a28-42c3-8042-eaa971488aec could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:39:41.200385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-e4eed134-af60-4be5-bc55-c80416166a1c tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec" status: 404 len: 111 microversion: 2.1 time: 0.032836 Aug 04 21:39:41.200385 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 574/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:41 2022] GET /compute/v2.1/servers/dd682ac7-5a28-42c3-8042-eaa971488aec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:39:41.815540 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:41.816126 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.compute.api [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118550) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:41.822376 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:41.822858 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:41.823289 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:41.824022 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:41.824474 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:41.824896 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG oslo_concurrency.lockutils [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:41.839004 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.wsgi [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] HTTP exception thrown: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Request method failure captured: Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: request: DELETE /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 HTTP/1.1 Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept: application/json Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Accept-Encoding: identity Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Connection: close Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Length: 0 Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Content-Type: application/json Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Host: 10.222.0.25 Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Openstack-System-Scope: None Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: User-Agent: python-urllib3/1.26.11 Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Auth-Token: gAAAAABi7Drh_e6ZBrUU_gq_HBfcIqZL4VitxJsQlez6ywTr0UBSyTA1z9ZFCouC9kXnk-07ogpfR_Kguiog2MbpEOYeCIVbwxg6IK2KSGGOIp0ezC9lRrUge5SMZmhHXXKOOik98IOD_nohm_C8z_IDv8hbXl41smBPFCVEyoArWL9gbFaapHM Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Id: None Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Domain-Name: None Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Identity-Status: Confirmed Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Is-Admin-Project: True Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Id: default Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Domain-Name: Default Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Project-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Role: member,reader Aug 04 21:39:41.840703 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Roles: member,reader Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-Tenant-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Id: default Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Domain-Name: Default Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Id: b665d491470f4a0b95c13f51e19d2046 Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: X-User-Name: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: method: > Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: exception: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.842506 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: action_args: {'id': '71b166cb-3712-4ff3-bed4-ec30a537e1d2'} Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:39:41.843390 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.844831 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.846234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Returning 404 to user: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. {{(pid=118550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:39:41.846234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-2f0cffd0-1813-40cf-aebc-83823a8cb396 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 404 len: 111 microversion: 2.1 time: 0.030493 Aug 04 21:39:41.846234 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 570/1144] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Aug 4 21:39:41 2022] DELETE /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:39:41.851373 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '>' {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:41.851986 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.compute.api [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] [instance: 71b166cb-3712-4ff3-bed4-ec30a537e1d2] Fetching instance by UUID {{(pid=118549) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 21:39:41.858008 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:41.858491 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:41.858929 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:41.859656 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Acquiring lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 21:39:41.860105 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 21:39:41.860532 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG oslo_concurrency.lockutils [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Lock "276ce854-5a06-42fd-a4c0-ee9620cd609a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 21:39:41.874103 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.wsgi [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] HTTP exception thrown: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Request method failure captured: Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: request: GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 HTTP/1.1 Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept: application/json Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Accept-Encoding: identity Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Connection: close Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Length: 0 Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Content-Type: application/json Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Host: 10.222.0.25 Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Openstack-System-Scope: None Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: User-Agent: python-urllib3/1.26.11 Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Auth-Token: gAAAAABi7Drh_e6ZBrUU_gq_HBfcIqZL4VitxJsQlez6ywTr0UBSyTA1z9ZFCouC9kXnk-07ogpfR_Kguiog2MbpEOYeCIVbwxg6IK2KSGGOIp0ezC9lRrUge5SMZmhHXXKOOik98IOD_nohm_C8z_IDv8hbXl41smBPFCVEyoArWL9gbFaapHM Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Id: None Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Domain-Name: None Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Identity-Status: Confirmed Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Is-Admin-Project: True Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Id: default Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Domain-Name: Default Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Project-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Role: member,reader Aug 04 21:39:41.875674 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Roles: member,reader Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5b54066610f6483aa66bc27b5b2de6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Id: 5b54066610f6483aa66bc27b5b2de6fe Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-Tenant-Name: tempest-TestVolumeBootPattern-349171386 Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Id: default Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Domain-Name: Default Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Id: b665d491470f4a0b95c13f51e19d2046 Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: X-User-Name: tempest-TestVolumeBootPattern-349171386-project Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: method: > Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: exception: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.878620 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: action_args: {'id': '71b166cb-3712-4ff3-bed4-ec30a537e1d2'} Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: {{(pid=118549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 21:39:41.880127 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. Aug 04 21:39:41.882745 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: ERROR nova.api.openstack.wsgi Aug 04 21:39:41.885320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: DEBUG nova.api.openstack.wsgi [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Returning 404 to user: Instance 71b166cb-3712-4ff3-bed4-ec30a537e1d2 could not be found. {{(pid=118549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 21:39:41.885320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO nova.api.openstack.requestlog [None req-f6a0b998-bf89-441b-b01c-332ce83a4771 tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2" status: 404 len: 111 microversion: 2.1 time: 0.030158 Aug 04 21:39:41.885320 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: [pid: 118549|app: 0|req: 575/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Aug 4 21:39:41 2022] GET /compute/v2.1/servers/71b166cb-3712-4ff3-bed4-ec30a537e1d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 21:39:43.471267 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: DEBUG nova.api.openstack.wsgi [None req-6f34bace-79f2-4c39-8fee-f0f4c7a18eca tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] Calling method '.version_select at 0x7f8e71080ee0>' {{(pid=118550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 21:39:43.582088 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO nova.api.openstack.requestlog [None req-6f34bace-79f2-4c39-8fee-f0f4c7a18eca tempest-TestVolumeBootPattern-349171386 tempest-TestVolumeBootPattern-349171386-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320534295" status: 202 len: 0 microversion: 2.1 time: 0.114594 Aug 04 21:39:43.582843 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: [pid: 118550|app: 0|req: 571/1146] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Aug 4 21:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320534295 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 21:40:18.628111 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:40:18.628821 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Thu Aug 4 21:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:40:23.297142 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:40:23.297881 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:41:58.231794 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:41:58.234012 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:42:20.118943 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:42:20.119902 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Thu Aug 4 21:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:43:38.636425 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:43:38.637167 dv-cinder-852208-1-iscsi devstack@n-api.service[118550]: Thu Aug 4 21:43:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:43:43.306905 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:43:43.307507 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 21:45:18.240261 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 21:45:18.240880 dv-cinder-852208-1-iscsi devstack@n-api.service[118549]: Thu Aug 4 21:45:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!